-- Logs begin at Thu 2022-05-19 12:45:24 UTC, end at Thu 2022-05-19 13:52:06 UTC. -- May 19 13:22:12.708459 dv-cinder-841125-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 19 13:22:12.716378 dv-cinder-841125-6-iscsi devstack@n-api.service[102942]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 19 13:22:12.719487 dv-cinder-841125-6-iscsi devstack@n-api.service[102942]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 19 13:22:12 2022] *** May 19 13:22:12.719487 dv-cinder-841125-6-iscsi devstack@n-api.service[102942]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 19 13:22:12.719487 dv-cinder-841125-6-iscsi devstack@n-api.service[102942]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 19 13:22:12.719487 dv-cinder-841125-6-iscsi devstack@n-api.service[102942]: nodename: dv-cinder-841125-6-iscsi May 19 13:22:12.719487 dv-cinder-841125-6-iscsi devstack@n-api.service[102942]: machine: x86_64 May 19 13:22:12.719487 dv-cinder-841125-6-iscsi devstack@n-api.service[102942]: clock source: unix May 19 13:22:12.719487 dv-cinder-841125-6-iscsi devstack@n-api.service[102942]: pcre jit disabled May 19 13:22:12.719487 dv-cinder-841125-6-iscsi devstack@n-api.service[102942]: detected number of CPU cores: 4 May 19 13:22:12.719487 dv-cinder-841125-6-iscsi devstack@n-api.service[102942]: current working directory: / May 19 13:22:12.719487 dv-cinder-841125-6-iscsi devstack@n-api.service[102942]: detected binary path: /usr/bin/uwsgi-core May 19 13:22:12.720102 dv-cinder-841125-6-iscsi devstack@n-api.service[102942]: your processes number limit is 47680 May 19 13:22:12.720102 dv-cinder-841125-6-iscsi devstack@n-api.service[102942]: your memory page size is 4096 bytes May 19 13:22:12.720102 dv-cinder-841125-6-iscsi devstack@n-api.service[102942]: detected max file descriptor number: 2048 May 19 13:22:12.720102 dv-cinder-841125-6-iscsi devstack@n-api.service[102942]: lock engine: pthread robust mutexes May 19 13:22:12.720102 dv-cinder-841125-6-iscsi devstack@n-api.service[102942]: thunder lock: enabled May 19 13:22:12.720102 dv-cinder-841125-6-iscsi devstack@n-api.service[102942]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 19 13:22:12.720102 dv-cinder-841125-6-iscsi devstack@n-api.service[102942]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 19 13:22:12.764268 dv-cinder-841125-6-iscsi devstack@n-api.service[102942]: Python main interpreter initialized at 0x56122d95d9c0 May 19 13:22:12.764268 dv-cinder-841125-6-iscsi devstack@n-api.service[102942]: python threads support enabled May 19 13:22:12.764268 dv-cinder-841125-6-iscsi devstack@n-api.service[102942]: your server socket listen backlog is limited to 100 connections May 19 13:22:12.764268 dv-cinder-841125-6-iscsi devstack@n-api.service[102942]: your mercy for graceful operations on workers is 90 seconds May 19 13:22:12.764713 dv-cinder-841125-6-iscsi devstack@n-api.service[102942]: mapped 403077 bytes (393 KB) for 2 cores May 19 13:22:12.764713 dv-cinder-841125-6-iscsi devstack@n-api.service[102942]: *** Operational MODE: preforking *** May 19 13:22:12.764942 dv-cinder-841125-6-iscsi devstack@n-api.service[102942]: *** uWSGI is running in multiple interpreter mode *** May 19 13:22:12.764942 dv-cinder-841125-6-iscsi devstack@n-api.service[102942]: spawned uWSGI master process (pid: 102942) May 19 13:22:12.765150 dv-cinder-841125-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 19 13:22:12.765696 dv-cinder-841125-6-iscsi devstack@n-api.service[102942]: spawned uWSGI worker 1 (pid: 102943, cores: 1) May 19 13:22:12.766622 dv-cinder-841125-6-iscsi devstack@n-api.service[102942]: spawned uWSGI worker 2 (pid: 102944, cores: 1) May 19 13:22:12.766622 dv-cinder-841125-6-iscsi devstack@n-api.service[102942]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 19 13:22:13.948332 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 19 13:22:13.976957 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 19 13:22:14.671063 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 13:22:14.671063 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: from cryptography.utils import int_from_bytes May 19 13:22:14.671325 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 13:22:14.671325 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: from cryptography.utils import int_from_bytes May 19 13:22:14.671478 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 13:22:14.671478 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: from cryptography.utils import int_from_bytes May 19 13:22:14.671592 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 13:22:14.671592 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: from cryptography.utils import int_from_bytes May 19 13:22:17.263220 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 19 13:22:17.263668 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 19 13:22:17.263997 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 19 13:22:17.264360 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 19 13:22:17.264624 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 19 13:22:17.265017 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.265345 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.265715 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.266028 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.266379 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.266677 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.266995 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.267323 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.267638 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.267898 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.268213 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.268542 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-841125-6-iscsi {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.268867 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.269176 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.269531 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.269835 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.270144 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.270453 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.270763 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.271259 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.271720 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.272031 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.272343 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.272683 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.273001 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.273313 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.273665 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.273980 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.274307 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.274626 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.275028 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-841125-6-iscsi {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.275349 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.275666 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.275986 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.276591 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.277111 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.277455 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.277805 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.278117 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.278431 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.278764 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.279090 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.279414 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.279738 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.280044 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.280356 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.280668 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.280992 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.281301 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.281636 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.281887 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.282195 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.282517 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.282842 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.283042 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 19 13:22:17.283416 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.283511 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 19 13:22:17.283597 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.283679 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.283818 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 19 13:22:17.283945 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.284178 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 19 13:22:17.284277 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.284437 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 19 13:22:17.284569 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.284824 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.284910 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.285152 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.285260 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.285505 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.285643 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.285829 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.285923 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.286159 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.286260 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.286471 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.286559 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.286792 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.286886 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.287109 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.287200 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.287425 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.287511 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.287691 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.287812 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.287993 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.288080 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.288318 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-841125-6-iscsi {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.288413 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.288642 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.288729 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.24 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.288952 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.289038 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.24 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.289262 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.289355 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.289606 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.289707 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.289921 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.290008 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.290245 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.290350 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.290556 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.290650 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.290919 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.291055 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.291227 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.291366 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.291568 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.292024 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.292258 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.292436 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.292596 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.292778 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.292927 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.293094 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.293236 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.293501 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.293605 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.293750 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.293847 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.294063 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.294149 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.294385 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.294477 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.294696 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.294789 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.294999 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.295097 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-841125-6-iscsi {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.295308 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.295400 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.295609 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.295710 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.295917 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.296012 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.296225 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.296386 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.296534 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.296698 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.296884 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.297014 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.297164 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.297335 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.297493 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.297686 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.297792 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.297996 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.298083 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.298319 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.298404 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.298635 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.298721 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.298953 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.299039 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.299260 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.299346 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.299558 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.299646 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.299860 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.299964 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.300165 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.300251 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.300482 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.300568 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.300783 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.300867 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.301085 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.301176 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.301332 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.301466 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.301664 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.301751 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.301992 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.302080 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.302314 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.302411 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.302618 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.302703 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.302873 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.302974 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.303122 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.303232 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.303441 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.303534 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.303761 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.303866 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.304068 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.304164 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.304379 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.304468 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.304687 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.304774 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.304993 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.305079 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.305300 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.305386 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.305630 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.305730 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.305935 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.306027 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.306238 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.306374 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.306537 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.306631 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.306838 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.306925 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.307158 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.307265 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.307483 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.307597 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.307896 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.308048 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.308306 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.24 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.308394 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.308549 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.24 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.308674 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.308858 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.308998 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.309201 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.309340 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.309547 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.309706 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.309854 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.310055 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.310175 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.310375 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.310498 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.310713 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.310811 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.311050 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.311144 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.311371 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.311459 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.311688 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.311774 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.312007 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.312110 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.312309 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.312393 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.312559 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.312653 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.312862 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.312965 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.313165 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.313252 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.313506 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.313596 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.313815 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.313915 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.314119 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.314206 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.314425 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.314520 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.314724 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.314820 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.315029 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.315114 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.315335 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.315432 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.315641 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.315736 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.315945 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.316032 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.316250 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.316336 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.316552 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.316639 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.316856 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.316943 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.317159 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.317308 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.317482 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.317627 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.317803 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.317956 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.318121 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.318282 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.318426 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.318597 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.318733 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.318912 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.319039 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.319227 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.319328 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.319551 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.319637 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.319886 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.319972 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.320204 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.320303 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.320525 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.320615 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.320830 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.320924 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.321134 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.321236 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.321472 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.321586 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.321779 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.321874 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.322089 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.322184 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.322405 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.322500 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.322704 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.322813 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.323008 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.323101 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.323355 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.323718 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.323817 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.323906 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.323997 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.324077 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.324239 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.324341 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.324539 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.324640 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.324840 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.324932 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.325147 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.325248 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.325472 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.325568 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.325777 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.325871 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.326078 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.326171 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.326395 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.326511 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.326714 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.326818 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.327018 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.327103 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.327327 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.327478 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.327622 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.327766 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.327936 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:22:17.328085 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.328232 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.328372 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.328544 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.328679 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.328856 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.328991 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.329173 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.329316 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.329497 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.329595 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.329811 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.329899 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.330142 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.330237 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.330457 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.330551 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.330769 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.330863 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.331091 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.331176 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.331398 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.331491 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.331706 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.331791 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.332019 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.332105 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.332331 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.332440 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.332643 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.332730 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.332962 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.333065 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.333276 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.333369 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.333621 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.333715 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.333935 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.334021 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.334242 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.334327 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.334558 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.334652 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.334885 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.334972 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.335198 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.335289 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.335503 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.335595 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.335842 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.335929 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.336159 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.336244 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.336470 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.336564 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.336785 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.336889 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.337093 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.337179 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.337480 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.337590 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.337728 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.337822 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.338034 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.338118 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.338340 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.338424 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.338650 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.338930 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.339017 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.339104 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.339326 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.339421 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.339638 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.339725 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.339952 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.340038 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.340263 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.340350 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.340575 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.340668 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.340884 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.340977 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.341207 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.341298 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.341542 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.341630 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.341864 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.341959 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.342177 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.342263 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.342495 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.342602 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.342807 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.342902 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.343119 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.343211 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.343428 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.343513 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.343734 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.343831 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.344040 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.344125 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.344346 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.344440 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.344656 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.344750 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.344962 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.345046 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.345279 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.345365 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.345618 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.345716 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.345925 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.346010 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.346241 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.346325 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.346549 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.346635 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.346865 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.347031 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.347174 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.347311 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.347458 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.347600 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.347756 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.347890 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.348069 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.348211 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.348381 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.348514 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.348687 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.348856 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.349011 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.349152 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.349323 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.349491 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.349656 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.349793 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.349982 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.350138 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.350271 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.350407 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.350575 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.350709 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.350887 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.351034 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.351199 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.351342 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.351510 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.351644 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.351823 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.351964 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.352132 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.352265 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.352452 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.352593 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.352804 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.352947 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.353080 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.353283 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.353450 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.353537 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.353694 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.353783 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.354016 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.354101 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.354368 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.354456 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.354700 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.354821 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.355020 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.355327 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.355470 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.355664 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.355785 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.355988 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.356094 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.356310 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.356403 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.356631 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.356736 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.356946 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.357033 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.357258 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.357350 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.357594 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.357690 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.357901 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.357998 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.358206 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.358293 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.358512 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.358599 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.358819 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.358904 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.359127 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.359211 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.359431 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.359518 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.359735 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.359821 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.360037 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.360122 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.360349 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.360435 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.360669 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.360761 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.360981 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.361075 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.361306 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.361394 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.361655 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.361757 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.361962 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.362055 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.362273 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.362368 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.362586 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.362670 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.362897 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.363004 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.363201 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.363301 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.363511 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.363608 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.363816 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.363910 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.364138 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.364232 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.364451 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.364537 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.364760 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.364853 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.365066 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.365151 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.365390 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.365506 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.365722 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.365809 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.366035 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.366128 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.366338 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.366431 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.366652 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.366738 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.366978 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.367064 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.367295 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.367382 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.367606 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.367694 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.367921 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.368015 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.368226 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.368310 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.368537 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.368624 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.368842 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.368933 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.369151 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.369245 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.369485 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.369576 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.369799 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.369884 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.370213 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.370330 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.370524 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.370637 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.370840 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.370957 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.371164 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.371259 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.371577 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.371745 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.371888 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.372083 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.372380 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.372480 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.372687 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.372776 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.373002 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.373095 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.373323 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.373439 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.373682 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.373789 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.373997 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.374090 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.374311 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.374404 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.374638 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.374740 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.374948 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.375048 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.375258 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.375358 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.375563 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.375654 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.375868 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.375967 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.376172 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.376271 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.376478 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.376569 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.376781 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.376874 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.377086 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.377204 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.377392 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.377553 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.377720 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.377813 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.378023 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.378123 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.378325 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.378409 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.378629 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.378715 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.378930 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.379016 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.379238 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.379323 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.379546 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.379629 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.379862 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.379946 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.380171 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.380254 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.380480 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.380574 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.380820 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.380915 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.381082 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.381175 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.381401 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.381514 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.381731 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.381818 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.382043 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.382131 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.382348 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.382447 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.382653 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.382738 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.382993 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.383079 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.383303 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.383398 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.383605 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.383694 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.383920 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.384007 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.384225 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.384323 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.384539 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.384633 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.384849 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.384947 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.385158 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.385244 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.385484 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.385572 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.385890 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.385977 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.386356 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.386450 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.386667 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.386751 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.386979 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.387064 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.387285 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.387377 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.387593 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.387676 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.387898 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.387981 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.388217 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.388307 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.388523 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.388614 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.388827 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.388911 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.389134 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.389219 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.389458 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.389557 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.389773 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.389866 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.390082 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.390167 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.390396 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.390646 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.390732 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.390986 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.391072 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.391303 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.391399 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.391611 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.391697 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.391918 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.392020 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.392230 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.392361 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.392529 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.392627 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.392836 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.392923 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.393162 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.393285 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.393500 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.393603 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.393813 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.393907 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.394118 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.394218 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.394426 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.394512 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.394736 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.394821 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.395041 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.395127 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.395350 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.395434 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.395654 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.395747 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.395966 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.396052 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.396270 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.396364 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.396571 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.396666 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.396874 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.396959 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.397178 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.397262 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.397511 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.397599 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.397821 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.397905 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.398125 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.398221 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.398425 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.398509 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.398726 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.398810 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.399034 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.399133 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.399335 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.399426 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.399639 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.399724 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.399943 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.400071 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.400250 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.400334 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.400560 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.400646 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.400866 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.400962 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.401219 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.401391 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.401598 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.401836 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.401938 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.402093 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.402180 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.402408 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.402506 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.402732 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.402825 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.403053 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.403137 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.403361 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.403444 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.403673 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.403767 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.403985 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.404087 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.404289 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.404373 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.404597 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.404693 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.404905 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.404990 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.405215 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.405299 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.405547 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.405634 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.405851 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.405934 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.406162 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.406249 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.406465 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.406560 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.406776 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.406860 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.407082 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.407165 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.407385 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.407474 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.407688 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.407776 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.407996 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.408083 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.408301 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.408423 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.408607 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.408693 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.408914 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.409011 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.409214 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.409307 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.409553 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.409651 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.409859 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.409952 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.410165 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.410250 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.410470 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.410555 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.410779 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.410880 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.411083 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.411167 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.411387 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.411473 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.411696 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.411790 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.412010 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.412096 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.412316 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.412407 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.412622 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.412721 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.412931 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.413016 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.413236 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.413320 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.413561 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.413648 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.413870 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.413954 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.414184 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.414278 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.414494 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.414582 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.414795 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.414930 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.415104 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.415244 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.415411 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.415560 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.415719 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.415869 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.416021 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.416184 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.416326 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.416497 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.416939 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.417310 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.417481 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.417668 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.417829 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.418048 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.418174 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.418352 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.418552 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.418807 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.418894 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.419173 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.419290 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.419491 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.419764 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.419870 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.420094 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.420239 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.420409 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.420710 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.420803 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.421031 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.421233 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.421342 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.421680 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.421779 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.422007 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.422277 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.422363 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.422625 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.422775 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.423041 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.423298 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.423385 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.423647 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.423816 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.424066 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.424281 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.424375 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.424682 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.424767 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.425119 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.425210 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.425883 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.425986 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.426104 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.426228 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.426335 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.426564 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.426710 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.426880 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.427110 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.427271 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.427522 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.427654 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.427839 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.427985 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.428165 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.428467 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.428646 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.428806 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.428923 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.429119 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.429428 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.429530 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.429761 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.429940 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.430177 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.430434 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.430526 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.430804 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.430901 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.431129 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.431391 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.431489 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.431751 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.431850 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.432063 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.432343 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.432437 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.432759 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.432949 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.433100 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.433305 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.433440 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.433730 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.433822 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.434043 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.434286 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.434383 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.434667 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.434766 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.434976 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.435230 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.435321 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.435597 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.435696 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.435905 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.436173 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.436269 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.436514 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.436611 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.436823 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.437084 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.437179 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.437489 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.437600 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.437800 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.438116 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.438211 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.438426 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.438727 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.438848 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.439032 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.439296 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.439401 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.439674 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.439871 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.440010 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.440352 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.440495 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.440685 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.440953 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.441087 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.441310 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.441538 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.441659 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.441975 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.442075 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.442300 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.442627 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.442848 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.442950 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.443227 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.443407 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.443528 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.443836 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.443982 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.444126 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.444433 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.444567 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.444752 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.445055 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.445193 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.445405 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.451633 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.451757 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.451831 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.451933 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.452039 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.452131 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.452222 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.452320 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.452320 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.452487 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.452579 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.452670 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.452754 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.452831 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.452925 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.452996 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.453077 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.453167 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.453167 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.453324 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.453592 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.453749 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.453851 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.453851 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.453977 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.454052 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.454120 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.454200 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.454276 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.454359 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.454428 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.454494 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.454560 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.454640 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.454709 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.454776 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.454851 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.454851 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.454973 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.455048 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.455048 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.455184 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.455251 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.455333 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.455414 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.455414 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.455546 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.455635 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.455717 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.455785 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.455785 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.455933 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.455933 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.456069 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.456069 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.456199 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.456287 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.456357 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.456426 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.456506 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.456582 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.456658 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.456747 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.456830 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.456918 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.457000 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.457081 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.457170 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.457261 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.457344 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.457534 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.457670 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.457856 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.458011 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.458192 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.458339 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.458525 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.458660 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.458853 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.459002 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.459199 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.459334 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.459518 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.459654 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.459837 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.459986 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.460160 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.460295 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.460480 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.460615 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.460830 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.460932 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.461134 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.461296 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.461457 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.461567 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.461781 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.461882 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.462085 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.462177 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.462403 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.462507 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.462706 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.462799 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.463020 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.463112 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.463331 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.463432 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.463643 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.463744 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.463969 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.464127 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.464346 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.464493 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.464585 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.464735 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.464886 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.465056 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.465214 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.465385 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.465540 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.465749 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.465840 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.466076 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.466175 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.466397 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.466488 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.466717 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.466806 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.467032 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.467129 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.467339 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.467548 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.467638 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.467868 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.467957 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.468207 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.468342 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.468539 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.468629 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.468857 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.468945 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.469176 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.469272 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.469521 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.469614 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.469840 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.469940 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.470151 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.470240 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.470460 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.470558 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.470775 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.470877 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.471088 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.471186 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.471397 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.471485 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.471708 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.471803 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.472015 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.472104 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.472321 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.472408 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.472623 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.472723 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.472929 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.473032 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.473238 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.473488 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.473591 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.473847 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.473937 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.474166 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.474255 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.474467 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.474575 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.474791 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.474933 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.475097 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.475194 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.475421 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.475590 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.475732 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.475821 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.476039 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.476126 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.476344 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.476433 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.476650 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.476737 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.476961 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.477048 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.477273 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.477363 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.477611 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.477701 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.477927 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.478015 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.478243 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.478335 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.478552 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.478649 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.478863 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.478949 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.479168 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.479264 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.479565 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.479711 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.479890 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.480204 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.480323 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.480512 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.480631 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.480823 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.480950 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.481142 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.481274 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.481475 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.481611 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.481791 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.481921 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.482109 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.482236 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.482427 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.482549 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.482749 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.482865 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.483174 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.483309 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.483490 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.483639 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.483806 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.483955 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.484126 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.484272 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.484442 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.484578 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.484764 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.484889 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.485120 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.485216 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.485469 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.485576 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.485786 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.485885 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.486095 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.486183 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.486414 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.486501 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.486725 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.486827 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.487054 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.487144 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.487369 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.487457 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.487683 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.487772 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.488001 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.488096 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.488316 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.488422 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.488635 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.488858 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.488947 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.489202 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.489363 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.489552 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.489645 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.489892 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.489982 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.490213 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.490300 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.490527 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.490616 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.490837 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.490927 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.491146 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.491242 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.491463 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.491553 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.491775 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.491863 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.492085 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.492173 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.492396 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.492484 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.492704 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.492791 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.493014 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.493110 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.493324 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.493548 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.493667 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.493755 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.493983 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.494087 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.494296 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.494385 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.494607 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.494710 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.494918 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.495060 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.495304 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.495453 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.495822 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.495942 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.496130 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.496229 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.496464 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.496553 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.496791 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.496880 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.497120 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.497218 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.497458 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.497553 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.497780 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.497882 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.498094 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.498182 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.498399 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.498487 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.498710 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.498809 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.499018 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.499107 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.499329 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.499417 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.499636 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.499737 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.499959 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.500056 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.500271 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.500385 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.500577 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.500705 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.500899 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.501030 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.501210 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.501360 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.501705 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.501818 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.502034 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.502131 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.502364 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.502494 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.502683 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.502773 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.503013 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.503101 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.503329 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.503416 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.503657 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.503745 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.503984 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.504080 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.504296 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.504385 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.504605 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.504694 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.504925 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.505015 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.505232 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.505446 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.505580 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.505664 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.505857 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.505947 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.506171 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.506267 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.506480 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.506568 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.506786 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.506881 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.507090 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.507186 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.507453 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.507559 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.507696 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.507791 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.508011 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.508118 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.508316 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.508403 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.508619 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.508722 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.508931 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.509105 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.509244 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.509334 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.509589 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.509680 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.509897 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.509988 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.510250 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.510344 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.510507 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.510633 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.510866 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.511079 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.511253 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.511405 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.511572 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.511710 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.511822 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.512032 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.512122 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.512342 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.512430 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.512661 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.512750 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.512971 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.513058 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.513304 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.513390 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.513636 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.513740 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.513952 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.514039 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.514261 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.514349 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.514582 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.514679 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.514893 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.514980 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.515205 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.515293 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.515533 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.515664 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.515848 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.515935 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.516166 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.516379 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.516468 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.516710 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.516798 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.517028 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.517116 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.517362 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.517503 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.517717 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.517807 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.518024 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.518113 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.518332 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.518421 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.518639 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.518727 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.518961 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.519078 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.519272 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.519384 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.519579 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.519676 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.519887 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.519992 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.520194 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.520289 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.520501 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.520596 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.520808 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.520913 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.521115 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.521220 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.521440 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.521539 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.521759 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.521865 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.522066 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.522154 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.522377 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.522465 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.522685 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.522780 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.522994 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.523080 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.523308 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.523408 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.523628 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.523725 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.523939 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.524025 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.524254 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.524342 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.524570 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.524658 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.524881 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.524968 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.525189 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.525285 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.525520 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.525613 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.525835 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.525935 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.526145 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.526280 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.526524 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.526622 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.526828 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.526916 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.527171 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.527272 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.527482 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.527629 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.527790 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 19 13:22:17.527938 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.528245 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.528564 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.528874 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.529197 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.529541 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.529854 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.530176 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.530488 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.530814 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.531147 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.531477 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.531814 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.532120 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.532424 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.532728 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.533037 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.533354 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.533689 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.533995 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.534296 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.534604 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.534907 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.535208 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.535511 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.535813 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.536118 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.536420 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.536725 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.537027 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.537330 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.537656 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.537958 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.538266 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.538569 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.538881 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.539189 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.539494 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.539795 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.540122 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.540455 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.540770 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.541091 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.541402 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.542135 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.542651 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.543044 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.543369 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.543685 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.543995 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.544328 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.544638 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.544948 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.545255 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.545595 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.545907 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.546216 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.546540 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.546865 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.547169 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.547491 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.547823 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.548125 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.548439 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.548749 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.549078 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.549387 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.549721 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.550038 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.550346 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.550655 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.550969 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.551285 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.551619 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.551945 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.552253 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.552582 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.552908 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.553255 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.553592 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.553939 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.554266 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.554581 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.554893 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.555200 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:22:17.555443 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 19 13:22:17.586585 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: INFO dbcounter [None req-6cd7c056-0c0d-4c83-afa5-7c41a1d1322d None None] Registered counter for database nova_api May 19 13:22:17.608728 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG oslo_db.sqlalchemy.engines [None req-6cd7c056-0c0d-4c83-afa5-7c41a1d1322d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102943) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 13:22:17.613985 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: INFO dbcounter [None req-d68b49a5-c6f8-40cb-bd3f-1ebadfb25b6c None None] Registered counter for database nova_api May 19 13:22:17.615725 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG dbcounter [-] [102943] Writer thread running {{(pid=102943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 13:22:17.634222 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG oslo_db.sqlalchemy.engines [None req-d68b49a5-c6f8-40cb-bd3f-1ebadfb25b6c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102944) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 13:22:17.641278 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG dbcounter [-] [102944] Writer thread running {{(pid=102944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 13:22:17.672148 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.context [None req-6cd7c056-0c0d-4c83-afa5-7c41a1d1322d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5bd426f0-9e44-4ba7-83d1-d4a29b25b071(cell1) {{(pid=102943) load_cells /opt/stack/nova/nova/context.py:464}} May 19 13:22:17.677684 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG oslo_concurrency.lockutils [None req-6cd7c056-0c0d-4c83-afa5-7c41a1d1322d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102943) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:22:17.679263 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG oslo_concurrency.lockutils [None req-6cd7c056-0c0d-4c83-afa5-7c41a1d1322d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102943) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:22:17.680048 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG oslo_concurrency.lockutils [None req-6cd7c056-0c0d-4c83-afa5-7c41a1d1322d None None] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102943) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:22:17.682045 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG oslo_concurrency.lockutils [None req-6cd7c056-0c0d-4c83-afa5-7c41a1d1322d None None] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102943) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:22:17.684172 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: INFO dbcounter [None req-6cd7c056-0c0d-4c83-afa5-7c41a1d1322d None None] Registered counter for database nova_cell0 May 19 13:22:17.688243 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: INFO dbcounter [None req-6cd7c056-0c0d-4c83-afa5-7c41a1d1322d None None] Registered counter for database nova_cell1 May 19 13:22:17.696477 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG oslo_db.sqlalchemy.engines [None req-6cd7c056-0c0d-4c83-afa5-7c41a1d1322d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102943) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 13:22:17.697476 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.context [None req-d68b49a5-c6f8-40cb-bd3f-1ebadfb25b6c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5bd426f0-9e44-4ba7-83d1-d4a29b25b071(cell1) {{(pid=102944) load_cells /opt/stack/nova/nova/context.py:464}} May 19 13:22:17.697933 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG oslo_db.sqlalchemy.engines [None req-6cd7c056-0c0d-4c83-afa5-7c41a1d1322d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102943) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 13:22:17.703168 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG oslo_concurrency.lockutils [None req-d68b49a5-c6f8-40cb-bd3f-1ebadfb25b6c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:22:17.704744 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG oslo_concurrency.lockutils [None req-d68b49a5-c6f8-40cb-bd3f-1ebadfb25b6c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:22:17.705114 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG dbcounter [-] [102943] Writer thread running {{(pid=102943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 13:22:17.705580 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG oslo_concurrency.lockutils [None req-d68b49a5-c6f8-40cb-bd3f-1ebadfb25b6c None None] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:22:17.706418 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG dbcounter [-] [102943] Writer thread running {{(pid=102943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 13:22:17.707537 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG oslo_concurrency.lockutils [None req-d68b49a5-c6f8-40cb-bd3f-1ebadfb25b6c None None] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:22:17.709543 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: INFO dbcounter [None req-d68b49a5-c6f8-40cb-bd3f-1ebadfb25b6c None None] Registered counter for database nova_cell0 May 19 13:22:17.713543 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: INFO dbcounter [None req-d68b49a5-c6f8-40cb-bd3f-1ebadfb25b6c None None] Registered counter for database nova_cell1 May 19 13:22:17.720409 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG oslo_db.sqlalchemy.engines [None req-d68b49a5-c6f8-40cb-bd3f-1ebadfb25b6c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102944) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 13:22:17.723860 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG oslo_db.sqlalchemy.engines [None req-d68b49a5-c6f8-40cb-bd3f-1ebadfb25b6c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102944) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 13:22:17.726287 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG dbcounter [-] [102944] Writer thread running {{(pid=102944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 13:22:17.853750 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: INFO dbcounter [None req-6cd7c056-0c0d-4c83-afa5-7c41a1d1322d None None] Registered counter for database nova_cell0 May 19 13:22:17.863377 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG oslo_db.sqlalchemy.engines [None req-6cd7c056-0c0d-4c83-afa5-7c41a1d1322d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102943) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 13:22:17.864672 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG dbcounter [-] [102944] Writer thread running {{(pid=102944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 13:22:17.868365 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG dbcounter [-] [102943] Writer thread running {{(pid=102943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 13:22:17.873690 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: INFO dbcounter [None req-d68b49a5-c6f8-40cb-bd3f-1ebadfb25b6c None None] Registered counter for database nova_cell0 May 19 13:22:17.882649 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG oslo_db.sqlalchemy.engines [None req-d68b49a5-c6f8-40cb-bd3f-1ebadfb25b6c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102944) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 13:22:17.886840 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG dbcounter [-] [102944] Writer thread running {{(pid=102944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 13:22:18.199688 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: WARNING keystonemiddleware.auth_token [None req-6cd7c056-0c0d-4c83-afa5-7c41a1d1322d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 19 13:22:18.206965 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: WARNING keystonemiddleware.auth_token [None req-6cd7c056-0c0d-4c83-afa5-7c41a1d1322d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 19 13:22:18.210523 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: WARNING keystonemiddleware.auth_token [None req-d68b49a5-c6f8-40cb-bd3f-1ebadfb25b6c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 19 13:22:18.217986 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: WARNING keystonemiddleware.auth_token [None req-d68b49a5-c6f8-40cb-bd3f-1ebadfb25b6c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 19 13:22:18.548103 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: WARNING keystonemiddleware.auth_token [None req-6cd7c056-0c0d-4c83-afa5-7c41a1d1322d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 19 13:22:18.554257 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: WARNING keystonemiddleware.auth_token [None req-6cd7c056-0c0d-4c83-afa5-7c41a1d1322d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 19 13:22:18.559526 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56122d95d9c0 pid: 102943 (default app) May 19 13:22:18.559679 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: WARNING keystonemiddleware.auth_token [None req-d68b49a5-c6f8-40cb-bd3f-1ebadfb25b6c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 19 13:22:18.561583 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi [None req-6cd7c056-0c0d-4c83-afa5-7c41a1d1322d None None] Calling method '>' {{(pid=102943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:22:18.562754 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: INFO nova.api.openstack.requestlog [None req-6cd7c056-0c0d-4c83-afa5-7c41a1d1322d None None] 10.222.0.24 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001737 May 19 13:22:18.563165 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: [pid: 102943|app: 0|req: 1/1] 10.222.0.24 () {50 vars in 788 bytes} [Thu May 19 13:22:18 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:22:18.565856 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: WARNING keystonemiddleware.auth_token [None req-d68b49a5-c6f8-40cb-bd3f-1ebadfb25b6c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 19 13:22:18.571196 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56122d95d9c0 pid: 102944 (default app) May 19 13:23:37.967831 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi [None req-6cd7c056-0c0d-4c83-afa5-7c41a1d1322d None None] Calling method '>' {{(pid=102943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:23:37.968941 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: INFO nova.api.openstack.requestlog [None req-6cd7c056-0c0d-4c83-afa5-7c41a1d1322d None None] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 May 19 13:23:37.969428 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: [pid: 102943|app: 0|req: 2/2] 10.222.0.24 () {54 vars in 930 bytes} [Thu May 19 13:23:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:23:37.981698 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG dbcounter [-] [102944] Writing DB stats nova_api:SELECT=3 {{(pid=102944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:23:37.982823 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG dbcounter [-] [102944] Writing DB stats nova_cell0:SELECT=3 {{(pid=102944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:23:37.983641 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG dbcounter [-] [102944] Writing DB stats nova_cell1:SELECT=3 {{(pid=102944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:23:37.985226 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG dbcounter [-] [102944] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=102944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:23:38.527751 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi [None req-569e0b91-8442-409e-9468-1a59d00fa426 admin admin] Calling method '>' {{(pid=102944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:23:38.557478 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: INFO nova.api.openstack.requestlog [None req-569e0b91-8442-409e-9468-1a59d00fa426 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.581120 May 19 13:23:38.558314 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: [pid: 102944|app: 0|req: 1/3] 10.222.0.24 () {60 vars in 1291 bytes} [Thu May 19 13:23:37 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:23:40.885837 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi [None req-6cd7c056-0c0d-4c83-afa5-7c41a1d1322d None None] Calling method '>' {{(pid=102943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:23:40.886836 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: INFO nova.api.openstack.requestlog [None req-6cd7c056-0c0d-4c83-afa5-7c41a1d1322d None None] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 May 19 13:23:40.887401 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: [pid: 102943|app: 0|req: 3/4] 10.222.0.24 () {54 vars in 930 bytes} [Thu May 19 13:23:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:23:40.953637 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi [None req-d5daf895-3b22-4c63-b4ed-8f08828d7e65 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "cirros256", "disk": 1, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256}} {{(pid=102944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:23:40.971546 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 13:23:40.971546 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: warnings.warn(msg) May 19 13:23:41.000430 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: INFO nova.api.openstack.requestlog [None req-d5daf895-3b22-4c63-b4ed-8f08828d7e65 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.106900 May 19 13:23:41.001375 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: [pid: 102944|app: 0|req: 2/5] 10.222.0.24 () {64 vars in 1282 bytes} [Thu May 19 13:23:40 2022] POST /compute/v2.1/flavors => generated 407 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 19 13:23:41.014738 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG dbcounter [-] [102943] Writing DB stats nova_api:SELECT=3 {{(pid=102943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:23:41.016010 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG dbcounter [-] [102943] Writing DB stats nova_cell1:SELECT=3 {{(pid=102943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:23:41.017091 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG dbcounter [-] [102943] Writing DB stats nova_cell0:SELECT=3 {{(pid=102943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:23:41.017935 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG dbcounter [-] [102943] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=102943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:23:41.220251 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi [None req-0fdd0f67-1c80-4c58-a6ae-b0a97874b5a0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:23:41.222719 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 13:23:41.222719 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: warnings.warn(msg) May 19 13:23:41.285472 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: INFO nova.api.openstack.requestlog [None req-0fdd0f67-1c80-4c58-a6ae-b0a97874b5a0 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.276033 May 19 13:23:41.286392 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: [pid: 102943|app: 0|req: 4/6] 10.222.0.24 () {64 vars in 1335 bytes} [Thu May 19 13:23:41 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:23:43.567416 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi [None req-d5daf895-3b22-4c63-b4ed-8f08828d7e65 admin admin] Calling method '>' {{(pid=102944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:23:43.568394 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: INFO nova.api.openstack.requestlog [None req-d5daf895-3b22-4c63-b4ed-8f08828d7e65 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001538 May 19 13:23:43.568803 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: [pid: 102944|app: 0|req: 3/7] 10.222.0.24 () {54 vars in 930 bytes} [Thu May 19 13:23:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:23:43.677065 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi [None req-6b7943ab-54ab-4487-96b8-fd8fad5fdbe9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "ds512M", "rxtx_factor": 1.0, "disk": 5, "os-flavor-access:is_public": true, "ram": 512, "swap": 0, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=102943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:23:43.694652 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 13:23:43.694652 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: warnings.warn(msg) May 19 13:23:43.713602 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: INFO nova.api.openstack.requestlog [None req-6b7943ab-54ab-4487-96b8-fd8fad5fdbe9 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.138514 May 19 13:23:43.714158 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: [pid: 102943|app: 0|req: 5/8] 10.222.0.24 () {64 vars in 1282 bytes} [Thu May 19 13:23:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 19 13:23:43.725896 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi [None req-482319da-f036-43b4-9c9e-2ce9d45971b2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:23:43.727587 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 13:23:43.727587 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: warnings.warn(msg) May 19 13:23:43.759814 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: INFO nova.api.openstack.requestlog [None req-482319da-f036-43b4-9c9e-2ce9d45971b2 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037592 May 19 13:23:43.760395 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: [pid: 102944|app: 0|req: 4/9] 10.222.0.24 () {64 vars in 1335 bytes} [Thu May 19 13:23:43 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:23:46.013711 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi [None req-6b7943ab-54ab-4487-96b8-fd8fad5fdbe9 admin admin] Calling method '>' {{(pid=102943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:23:46.014718 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: INFO nova.api.openstack.requestlog [None req-6b7943ab-54ab-4487-96b8-fd8fad5fdbe9 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 May 19 13:23:46.015078 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: [pid: 102943|app: 0|req: 6/10] 10.222.0.24 () {54 vars in 930 bytes} [Thu May 19 13:23:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:23:46.079328 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi [None req-c3b339bf-2ce1-4c8d-88d8-ad96841285ea admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "id": "d2", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 1, "ram": 1024, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=102944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:23:46.099052 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: INFO nova.api.openstack.requestlog [None req-c3b339bf-2ce1-4c8d-88d8-ad96841285ea admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.077954 May 19 13:23:46.099598 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: [pid: 102944|app: 0|req: 5/11] 10.222.0.24 () {64 vars in 1282 bytes} [Thu May 19 13:23:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 19 13:23:46.112059 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi [None req-31cbf5f9-d96a-4b94-8a92-7b31a32ea707 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:23:46.138982 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: INFO nova.api.openstack.requestlog [None req-31cbf5f9-d96a-4b94-8a92-7b31a32ea707 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030568 May 19 13:23:46.140009 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: [pid: 102943|app: 0|req: 7/12] 10.222.0.24 () {64 vars in 1335 bytes} [Thu May 19 13:23:46 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:23:48.416741 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi [None req-c3b339bf-2ce1-4c8d-88d8-ad96841285ea admin admin] Calling method '>' {{(pid=102944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:23:48.417856 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: INFO nova.api.openstack.requestlog [None req-c3b339bf-2ce1-4c8d-88d8-ad96841285ea admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001817 May 19 13:23:48.418237 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: [pid: 102944|app: 0|req: 6/13] 10.222.0.24 () {54 vars in 930 bytes} [Thu May 19 13:23:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:23:48.483793 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi [None req-484c4821-bff7-40ff-9ed3-7f3d8d652c52 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 2, "name": "ds2G", "ram": 2048, "rxtx_factor": 1.0, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "d3"}} {{(pid=102943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:23:48.503476 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: INFO nova.api.openstack.requestlog [None req-484c4821-bff7-40ff-9ed3-7f3d8d652c52 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.078967 May 19 13:23:48.504040 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: [pid: 102943|app: 0|req: 8/14] 10.222.0.24 () {64 vars in 1282 bytes} [Thu May 19 13:23:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 13:23:48.516564 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi [None req-90832752-5825-4722-93d5-24d97829d5e7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:23:48.542461 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: INFO nova.api.openstack.requestlog [None req-90832752-5825-4722-93d5-24d97829d5e7 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029802 May 19 13:23:48.543090 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: [pid: 102944|app: 0|req: 7/15] 10.222.0.24 () {64 vars in 1335 bytes} [Thu May 19 13:23:48 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:23:50.793873 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi [None req-484c4821-bff7-40ff-9ed3-7f3d8d652c52 admin admin] Calling method '>' {{(pid=102943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:23:50.794791 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: INFO nova.api.openstack.requestlog [None req-484c4821-bff7-40ff-9ed3-7f3d8d652c52 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 May 19 13:23:50.795429 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: [pid: 102943|app: 0|req: 9/16] 10.222.0.24 () {54 vars in 930 bytes} [Thu May 19 13:23:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:23:50.857063 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi [None req-eb990c21-d156-4974-853e-3c9f06816d8e admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "id": "d4", "rxtx_factor": 1.0, "disk": 20, "swap": 0, "vcpus": 4, "name": "ds4G"}} {{(pid=102944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:23:50.875799 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: INFO nova.api.openstack.requestlog [None req-eb990c21-d156-4974-853e-3c9f06816d8e admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074605 May 19 13:23:50.882017 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: [pid: 102944|app: 0|req: 8/17] 10.222.0.24 () {64 vars in 1282 bytes} [Thu May 19 13:23:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 13:23:50.889008 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi [None req-a6bf95ee-700d-478d-b4d1-a71374449ac2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:23:50.914847 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: INFO nova.api.openstack.requestlog [None req-a6bf95ee-700d-478d-b4d1-a71374449ac2 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029947 May 19 13:23:50.915409 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: [pid: 102943|app: 0|req: 10/18] 10.222.0.24 () {64 vars in 1335 bytes} [Thu May 19 13:23:50 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:23:53.191859 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi [None req-eb990c21-d156-4974-853e-3c9f06816d8e admin admin] Calling method '>' {{(pid=102944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:23:53.192870 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: INFO nova.api.openstack.requestlog [None req-eb990c21-d156-4974-853e-3c9f06816d8e admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 May 19 13:23:53.193272 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: [pid: 102944|app: 0|req: 9/19] 10.222.0.24 () {54 vars in 930 bytes} [Thu May 19 13:23:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:23:53.253974 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi [None req-11c7b26e-9c69-47f7-87bc-d154165a9722 admin admin] Calling method '>' {{(pid=102943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:23:53.280303 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: INFO nova.api.openstack.requestlog [None req-11c7b26e-9c69-47f7-87bc-d154165a9722 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.080392 May 19 13:23:53.281549 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: [pid: 102943|app: 0|req: 11/20] 10.222.0.24 () {60 vars in 1291 bytes} [Thu May 19 13:23:53 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:23:55.534086 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi [None req-eb990c21-d156-4974-853e-3c9f06816d8e admin admin] Calling method '>' {{(pid=102944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:23:55.535109 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: INFO nova.api.openstack.requestlog [None req-eb990c21-d156-4974-853e-3c9f06816d8e admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 May 19 13:23:55.535560 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: [pid: 102944|app: 0|req: 10/21] 10.222.0.24 () {54 vars in 930 bytes} [Thu May 19 13:23:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:23:55.598705 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi [None req-0a11d1c7-5d90-480a-a502-5ef3702136b5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "os-flavor-access:is_public": true, "name": "m1.tiny", "vcpus": 1, "disk": 1, "rxtx_factor": 1.0, "id": "1", "swap": 0}} {{(pid=102943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:23:55.618433 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: INFO nova.api.openstack.requestlog [None req-0a11d1c7-5d90-480a-a502-5ef3702136b5 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.076330 May 19 13:23:55.618971 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: [pid: 102943|app: 0|req: 12/22] 10.222.0.24 () {64 vars in 1282 bytes} [Thu May 19 13:23:55 2022] POST /compute/v2.1/flavors => generated 402 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 13:23:55.630703 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi [None req-f5e8d493-299a-4af7-b25b-d9171c1618b1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:23:55.655637 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: INFO nova.api.openstack.requestlog [None req-f5e8d493-299a-4af7-b25b-d9171c1618b1 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028529 May 19 13:23:55.656209 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: [pid: 102944|app: 0|req: 11/23] 10.222.0.24 () {64 vars in 1332 bytes} [Thu May 19 13:23:55 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:23:57.896006 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi [None req-0a11d1c7-5d90-480a-a502-5ef3702136b5 admin admin] Calling method '>' {{(pid=102943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:23:57.897028 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: INFO nova.api.openstack.requestlog [None req-0a11d1c7-5d90-480a-a502-5ef3702136b5 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 May 19 13:23:57.897386 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: [pid: 102943|app: 0|req: 13/24] 10.222.0.24 () {54 vars in 930 bytes} [Thu May 19 13:23:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:23:57.956785 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi [None req-15dee808-b9d9-4b3e-a287-3e3a7dc9d852 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.small", "vcpus": 1, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "swap": 0, "ram": 2048, "rxtx_factor": 1.0}} {{(pid=102944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:23:57.976462 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: INFO nova.api.openstack.requestlog [None req-15dee808-b9d9-4b3e-a287-3e3a7dc9d852 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.072499 May 19 13:23:57.976827 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: [pid: 102944|app: 0|req: 12/25] 10.222.0.24 () {64 vars in 1282 bytes} [Thu May 19 13:23:57 2022] POST /compute/v2.1/flavors => generated 405 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 13:23:57.988952 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi [None req-712a8728-c8a9-46d9-a732-baf71bdb0855 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:23:58.015628 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: INFO nova.api.openstack.requestlog [None req-712a8728-c8a9-46d9-a732-baf71bdb0855 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030191 May 19 13:23:58.022771 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: [pid: 102943|app: 0|req: 14/26] 10.222.0.24 () {64 vars in 1332 bytes} [Thu May 19 13:23:57 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:24:00.287659 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi [None req-15dee808-b9d9-4b3e-a287-3e3a7dc9d852 admin admin] Calling method '>' {{(pid=102944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:24:00.289851 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: INFO nova.api.openstack.requestlog [None req-15dee808-b9d9-4b3e-a287-3e3a7dc9d852 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002538 May 19 13:24:00.290480 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: [pid: 102944|app: 0|req: 13/27] 10.222.0.24 () {54 vars in 930 bytes} [Thu May 19 13:24:00 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:24:00.357292 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi [None req-06f66d6c-7935-4c81-a237-27923e6dad86 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.medium", "disk": 40, "swap": 0, "ram": 4096, "id": "3", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=102943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:24:00.403271 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: INFO nova.api.openstack.requestlog [None req-06f66d6c-7935-4c81-a237-27923e6dad86 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.103779 May 19 13:24:00.404494 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: [pid: 102943|app: 0|req: 15/28] 10.222.0.24 () {64 vars in 1282 bytes} [Thu May 19 13:24:00 2022] POST /compute/v2.1/flavors => generated 406 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 19 13:24:00.417052 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi [None req-3104fdd5-2f81-4055-8f6e-f10b8e74115d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:24:00.446326 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: INFO nova.api.openstack.requestlog [None req-3104fdd5-2f81-4055-8f6e-f10b8e74115d admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033238 May 19 13:24:00.447326 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: [pid: 102944|app: 0|req: 14/29] 10.222.0.24 () {64 vars in 1332 bytes} [Thu May 19 13:24:00 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:24:02.693549 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi [None req-06f66d6c-7935-4c81-a237-27923e6dad86 admin admin] Calling method '>' {{(pid=102943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:24:02.694642 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: INFO nova.api.openstack.requestlog [None req-06f66d6c-7935-4c81-a237-27923e6dad86 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 May 19 13:24:02.695075 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: [pid: 102943|app: 0|req: 16/30] 10.222.0.24 () {54 vars in 930 bytes} [Thu May 19 13:24:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:24:02.754381 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi [None req-3668c812-d7f6-4a2e-af2b-69fde7fbe39b admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 80, "swap": 0, "vcpus": 4, "ram": 8192, "name": "m1.large", "id": "4"}} {{(pid=102944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:24:02.774829 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: INFO nova.api.openstack.requestlog [None req-3668c812-d7f6-4a2e-af2b-69fde7fbe39b admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.073664 May 19 13:24:02.775414 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: [pid: 102944|app: 0|req: 15/31] 10.222.0.24 () {64 vars in 1282 bytes} [Thu May 19 13:24:02 2022] POST /compute/v2.1/flavors => generated 405 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 13:24:02.786902 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi [None req-92708201-7ab7-406b-a130-3fa62ddda06e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:24:02.811229 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: INFO nova.api.openstack.requestlog [None req-92708201-7ab7-406b-a130-3fa62ddda06e admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028041 May 19 13:24:02.811888 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: [pid: 102943|app: 0|req: 17/32] 10.222.0.24 () {64 vars in 1332 bytes} [Thu May 19 13:24:02 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:24:05.053034 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi [None req-3668c812-d7f6-4a2e-af2b-69fde7fbe39b admin admin] Calling method '>' {{(pid=102944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:24:05.056366 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: INFO nova.api.openstack.requestlog [None req-3668c812-d7f6-4a2e-af2b-69fde7fbe39b admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001605 May 19 13:24:05.057345 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: [pid: 102944|app: 0|req: 16/33] 10.222.0.24 () {54 vars in 930 bytes} [Thu May 19 13:24:05 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:24:05.152418 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi [None req-463693e1-d91f-4705-abb9-b1471d0e29ad admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "disk": 160, "swap": 0, "vcpus": 8, "rxtx_factor": 1.0, "ram": 16384, "id": "5", "os-flavor-access:is_public": true}} {{(pid=102943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:24:05.199631 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: INFO nova.api.openstack.requestlog [None req-463693e1-d91f-4705-abb9-b1471d0e29ad admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.135327 May 19 13:24:05.200441 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: [pid: 102943|app: 0|req: 18/34] 10.222.0.24 () {64 vars in 1282 bytes} [Thu May 19 13:24:05 2022] POST /compute/v2.1/flavors => generated 408 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 13:24:05.214510 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi [None req-f87e1096-904f-45b2-9c80-12007dff6b3d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:24:05.259334 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: INFO nova.api.openstack.requestlog [None req-f87e1096-904f-45b2-9c80-12007dff6b3d admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.047476 May 19 13:24:05.259862 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: [pid: 102944|app: 0|req: 17/35] 10.222.0.24 () {64 vars in 1332 bytes} [Thu May 19 13:24:05 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:24:29.442864 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi [None req-463693e1-d91f-4705-abb9-b1471d0e29ad admin admin] Calling method '>' {{(pid=102943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:24:29.444336 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: INFO nova.api.openstack.requestlog [None req-463693e1-d91f-4705-abb9-b1471d0e29ad admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001862 May 19 13:24:29.444907 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: [pid: 102943|app: 0|req: 19/36] 10.222.0.24 () {54 vars in 930 bytes} [Thu May 19 13:24:29 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:24:29.455710 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG dbcounter [-] [102944] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=102944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:24:29.508852 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi [None req-70b9e9d8-1cb1-4532-be7d-e3751defee79 admin admin] Calling method '>' {{(pid=102944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:24:29.526373 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: INFO nova.api.openstack.requestlog [None req-70b9e9d8-1cb1-4532-be7d-e3751defee79 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.075125 May 19 13:24:29.526841 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: [pid: 102944|app: 0|req: 18/37] 10.222.0.24 () {60 vars in 1291 bytes} [Thu May 19 13:24:29 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:24:30.563603 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi [None req-463693e1-d91f-4705-abb9-b1471d0e29ad admin admin] Calling method '>' {{(pid=102943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:24:30.564604 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: INFO nova.api.openstack.requestlog [None req-463693e1-d91f-4705-abb9-b1471d0e29ad admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 May 19 13:24:30.564971 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: [pid: 102943|app: 0|req: 20/38] 10.222.0.24 () {56 vars in 1074 bytes} [Thu May 19 13:24:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:24:30.784861 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi [None req-d1477506-d855-4618-a3d2-33dbbc3ad5fb admin admin] Calling method '>' {{(pid=102944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:24:30.792318 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: INFO nova.api.openstack.wsgi [None req-d1477506-d855-4618-a3d2-33dbbc3ad5fb admin admin] HTTP exception thrown: Flavor 42 could not be found. May 19 13:24:30.795706 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi [None req-d1477506-d855-4618-a3d2-33dbbc3ad5fb admin admin] Request method failure captured: May 19 13:24:30.795706 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 19 13:24:30.795706 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: Accept: application/json May 19 13:24:30.795706 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: Accept-Encoding: gzip, deflate May 19 13:24:30.795706 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: Connection: keep-alive May 19 13:24:30.795706 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: Content-Length: 0 May 19 13:24:30.795706 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: Host: 10.222.0.24 May 19 13:24:30.795706 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: Openstack-Api-Version: compute 2.90 May 19 13:24:30.795706 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: Openstack-System-Scope: None May 19 13:24:30.795706 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: User-Agent: python-novaclient May 19 13:24:30.795706 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: X-Auth-Token: gAAAAABihkUO8Hg1hZKUzt5zS2wsVS-NwJ30H7_1u6uLkuhAA2mvUG8U3ZpjdEGl_LUa_rQTXckN4V43yBGI4-CIiVUTAniIrTPXHg4Et1YuyxOdu3fZ2SYrHDaaFPyOfbktCLHXwgwAEX8sZS5vkYkr-NsVazlprBYV4xLyuj5mTdN1jmDCYJM May 19 13:24:30.795706 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: X-Domain-Id: None May 19 13:24:30.795706 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: X-Domain-Name: None May 19 13:24:30.795706 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: X-Identity-Status: Confirmed May 19 13:24:30.795706 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: X-Is-Admin-Project: True May 19 13:24:30.795706 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: X-Openstack-Nova-Api-Version: 2.90 May 19 13:24:30.795706 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: X-Project-Domain-Id: default May 19 13:24:30.795706 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: X-Project-Domain-Name: Default May 19 13:24:30.795706 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: X-Project-Id: 863bcb4c192047ed8ae210a081ac829f May 19 13:24:30.795706 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: X-Project-Name: admin May 19 13:24:30.795706 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: X-Role: admin,reader,member May 19 13:24:30.795706 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: X-Roles: admin,reader,member May 19 13:24:30.797436 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/863bcb4c192047ed8ae210a081ac829f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/863bcb4c192047ed8ae210a081ac829f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_863bcb4c192047ed8ae210a081ac829f", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/863bcb4c192047ed8ae210a081ac829f"}]}] May 19 13:24:30.797436 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: X-Tenant: admin May 19 13:24:30.797436 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: X-Tenant-Id: 863bcb4c192047ed8ae210a081ac829f May 19 13:24:30.797436 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: X-Tenant-Name: admin May 19 13:24:30.797436 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: X-User: admin May 19 13:24:30.797436 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: X-User-Domain-Id: default May 19 13:24:30.797436 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: X-User-Domain-Name: Default May 19 13:24:30.797436 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: X-User-Id: e50c121ca4544e98a148c3b6b1759f0d May 19 13:24:30.797436 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: X-User-Name: admin May 19 13:24:30.797436 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: method: > May 19 13:24:30.797436 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: exception: Flavor 42 could not be found. May 19 13:24:30.797436 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: action_args: {'id': '42'} May 19 13:24:30.797436 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: {{(pid=102944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:24:30.797436 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:24:30.798470 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 19 13:24:30.798470 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 19 13:24:30.798470 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 19 13:24:30.798470 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 19 13:24:30.798470 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 13:24:30.798470 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 13:24:30.798470 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 19 13:24:30.798470 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 19 13:24:30.798470 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 19 13:24:30.798470 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:24:30.798470 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 19 13:24:30.798470 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 19 13:24:30.798470 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 19 13:24:30.798470 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi May 19 13:24:30.798470 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:24:30.798470 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi May 19 13:24:30.798470 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:24:30.798470 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:24:30.798470 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:24:30.799954 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:24:30.799954 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:24:30.799954 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:24:30.799954 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:24:30.799954 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 19 13:24:30.799954 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 13:24:30.799954 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 19 13:24:30.799954 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi May 19 13:24:30.799954 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:24:30.799954 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi May 19 13:24:30.799954 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:24:30.799954 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:24:30.799954 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:24:30.799954 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:24:30.799954 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:24:30.799954 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 19 13:24:30.799954 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi May 19 13:24:30.799954 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi [None req-d1477506-d855-4618-a3d2-33dbbc3ad5fb admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:24:30.801377 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: INFO nova.api.openstack.requestlog [None req-d1477506-d855-4618-a3d2-33dbbc3ad5fb admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.083724 May 19 13:24:30.801377 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: [pid: 102944|app: 0|req: 19/39] 10.222.0.24 () {60 vars in 1190 bytes} [Thu May 19 13:24:30 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 19 13:24:30.807056 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi [None req-e56bb069-afd0-4dfc-9ce5-7849c79b419e admin admin] Calling method '>' {{(pid=102943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:24:30.810038 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG dbcounter [-] [102943] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=102943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:24:30.836038 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: INFO nova.api.openstack.requestlog [None req-e56bb069-afd0-4dfc-9ce5-7849c79b419e admin admin] 10.222.0.24 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.032263 May 19 13:24:30.836729 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: [pid: 102943|app: 0|req: 21/40] 10.222.0.24 () {60 vars in 1210 bytes} [Thu May 19 13:24:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:24:30.849618 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi [None req-8f61d71d-f469-4a2a-982c-c444c874d8a0 admin admin] Calling method '>' {{(pid=102944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:24:30.871379 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: INFO nova.api.openstack.requestlog [None req-8f61d71d-f469-4a2a-982c-c444c874d8a0 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025386 May 19 13:24:30.871933 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: [pid: 102944|app: 0|req: 20/41] 10.222.0.24 () {60 vars in 1210 bytes} [Thu May 19 13:24:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:24:30.881675 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi [None req-5913ef40-063a-4abe-bbac-a70682fda49a admin admin] Calling method '>' {{(pid=102943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:24:30.888767 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: INFO nova.api.openstack.wsgi [None req-5913ef40-063a-4abe-bbac-a70682fda49a admin admin] HTTP exception thrown: Flavor 42 could not be found. May 19 13:24:30.892086 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi [None req-5913ef40-063a-4abe-bbac-a70682fda49a admin admin] Request method failure captured: May 19 13:24:30.892086 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 19 13:24:30.892086 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: Accept: application/json May 19 13:24:30.892086 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: Accept-Encoding: gzip, deflate May 19 13:24:30.892086 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: Connection: keep-alive May 19 13:24:30.892086 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: Content-Length: 0 May 19 13:24:30.892086 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: Host: 10.222.0.24 May 19 13:24:30.892086 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: Openstack-Api-Version: compute 2.90 May 19 13:24:30.892086 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: Openstack-System-Scope: None May 19 13:24:30.892086 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: User-Agent: python-novaclient May 19 13:24:30.892086 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: X-Auth-Token: gAAAAABihkUO8Hg1hZKUzt5zS2wsVS-NwJ30H7_1u6uLkuhAA2mvUG8U3ZpjdEGl_LUa_rQTXckN4V43yBGI4-CIiVUTAniIrTPXHg4Et1YuyxOdu3fZ2SYrHDaaFPyOfbktCLHXwgwAEX8sZS5vkYkr-NsVazlprBYV4xLyuj5mTdN1jmDCYJM May 19 13:24:30.892086 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: X-Domain-Id: None May 19 13:24:30.892086 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: X-Domain-Name: None May 19 13:24:30.892086 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: X-Identity-Status: Confirmed May 19 13:24:30.892086 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: X-Is-Admin-Project: True May 19 13:24:30.892086 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: X-Openstack-Nova-Api-Version: 2.90 May 19 13:24:30.892086 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: X-Project-Domain-Id: default May 19 13:24:30.892086 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: X-Project-Domain-Name: Default May 19 13:24:30.892086 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: X-Project-Id: 863bcb4c192047ed8ae210a081ac829f May 19 13:24:30.892086 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: X-Project-Name: admin May 19 13:24:30.892086 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: X-Role: admin,reader,member May 19 13:24:30.892086 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: X-Roles: admin,reader,member May 19 13:24:30.893600 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/863bcb4c192047ed8ae210a081ac829f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/863bcb4c192047ed8ae210a081ac829f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_863bcb4c192047ed8ae210a081ac829f", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/863bcb4c192047ed8ae210a081ac829f"}]}] May 19 13:24:30.893600 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: X-Tenant: admin May 19 13:24:30.893600 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: X-Tenant-Id: 863bcb4c192047ed8ae210a081ac829f May 19 13:24:30.893600 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: X-Tenant-Name: admin May 19 13:24:30.893600 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: X-User: admin May 19 13:24:30.893600 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: X-User-Domain-Id: default May 19 13:24:30.893600 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: X-User-Domain-Name: Default May 19 13:24:30.893600 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: X-User-Id: e50c121ca4544e98a148c3b6b1759f0d May 19 13:24:30.893600 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: X-User-Name: admin May 19 13:24:30.893600 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: method: > May 19 13:24:30.893600 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: exception: Flavor 42 could not be found. May 19 13:24:30.893600 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: action_args: {'id': '42'} May 19 13:24:30.893600 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: {{(pid=102943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:24:30.893600 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:24:30.894476 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 19 13:24:30.894476 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 19 13:24:30.894476 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 19 13:24:30.894476 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 19 13:24:30.894476 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 13:24:30.894476 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 13:24:30.894476 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 19 13:24:30.894476 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 19 13:24:30.894476 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 19 13:24:30.894476 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:24:30.894476 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 19 13:24:30.894476 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 19 13:24:30.894476 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 19 13:24:30.894476 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi May 19 13:24:30.894476 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:24:30.894476 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi May 19 13:24:30.894476 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:24:30.894476 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:24:30.894476 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:24:30.895572 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:24:30.895572 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:24:30.895572 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:24:30.895572 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:24:30.895572 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 19 13:24:30.895572 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 13:24:30.895572 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 19 13:24:30.895572 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi May 19 13:24:30.895572 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:24:30.895572 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi May 19 13:24:30.895572 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:24:30.895572 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:24:30.895572 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:24:30.895572 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:24:30.895572 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:24:30.895572 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 19 13:24:30.895572 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi May 19 13:24:30.895572 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi [None req-5913ef40-063a-4abe-bbac-a70682fda49a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102943) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:24:30.896581 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: INFO nova.api.openstack.requestlog [None req-5913ef40-063a-4abe-bbac-a70682fda49a admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015628 May 19 13:24:30.896581 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: [pid: 102943|app: 0|req: 22/42] 10.222.0.24 () {60 vars in 1190 bytes} [Thu May 19 13:24:30 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 19 13:24:31.782273 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi [None req-8f61d71d-f469-4a2a-982c-c444c874d8a0 admin admin] Calling method '>' {{(pid=102944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:24:31.783287 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: INFO nova.api.openstack.requestlog [None req-8f61d71d-f469-4a2a-982c-c444c874d8a0 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 May 19 13:24:31.783652 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: [pid: 102944|app: 0|req: 21/43] 10.222.0.24 () {56 vars in 1074 bytes} [Thu May 19 13:24:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:24:31.984487 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi [None req-d1cfbe22-906a-4d17-9cbb-235730d6d833 admin admin] Calling method '>' {{(pid=102943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:24:31.993066 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: INFO nova.api.openstack.wsgi [None req-d1cfbe22-906a-4d17-9cbb-235730d6d833 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 19 13:24:31.994551 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi [None req-d1cfbe22-906a-4d17-9cbb-235730d6d833 admin admin] Request method failure captured: May 19 13:24:31.994551 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 19 13:24:31.994551 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: Accept: application/json May 19 13:24:31.994551 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: Accept-Encoding: gzip, deflate May 19 13:24:31.994551 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: Connection: keep-alive May 19 13:24:31.994551 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: Content-Length: 0 May 19 13:24:31.994551 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: Host: 10.222.0.24 May 19 13:24:31.994551 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: Openstack-Api-Version: compute 2.90 May 19 13:24:31.994551 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: Openstack-System-Scope: None May 19 13:24:31.994551 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: User-Agent: python-novaclient May 19 13:24:31.994551 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: X-Auth-Token: gAAAAABihkUP_8Z7hi8ugQ1-iMMpCTyQblZTsSwWZi-6BH7r_uiD30CLFWqfIjKrFIxGPmjPS-9mU43at7qctqQ7haAOHVZYwufvaIDgVAuHOjFNb9r4-9Q1BPQpki4pQFdCJy-eO-om5IMhft9jP8ofm2PXddKYLbFy4JPit1gleWzyXQ0neEA May 19 13:24:31.994551 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: X-Domain-Id: None May 19 13:24:31.994551 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: X-Domain-Name: None May 19 13:24:31.994551 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: X-Identity-Status: Confirmed May 19 13:24:31.994551 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: X-Is-Admin-Project: True May 19 13:24:31.994551 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: X-Openstack-Nova-Api-Version: 2.90 May 19 13:24:31.994551 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: X-Project-Domain-Id: default May 19 13:24:31.994551 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: X-Project-Domain-Name: Default May 19 13:24:31.994551 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: X-Project-Id: 863bcb4c192047ed8ae210a081ac829f May 19 13:24:31.994551 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: X-Project-Name: admin May 19 13:24:31.994551 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: X-Role: admin,reader,member May 19 13:24:31.994551 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: X-Roles: admin,reader,member May 19 13:24:31.996039 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/863bcb4c192047ed8ae210a081ac829f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/863bcb4c192047ed8ae210a081ac829f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_863bcb4c192047ed8ae210a081ac829f", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/863bcb4c192047ed8ae210a081ac829f"}]}] May 19 13:24:31.996039 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: X-Tenant: admin May 19 13:24:31.996039 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: X-Tenant-Id: 863bcb4c192047ed8ae210a081ac829f May 19 13:24:31.996039 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: X-Tenant-Name: admin May 19 13:24:31.996039 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: X-User: admin May 19 13:24:31.996039 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: X-User-Domain-Id: default May 19 13:24:31.996039 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: X-User-Domain-Name: Default May 19 13:24:31.996039 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: X-User-Id: e50c121ca4544e98a148c3b6b1759f0d May 19 13:24:31.996039 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: X-User-Name: admin May 19 13:24:31.996039 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: method: > May 19 13:24:31.996039 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: exception: Flavor 84 could not be found. May 19 13:24:31.996039 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: action_args: {'id': '84'} May 19 13:24:31.996039 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: {{(pid=102943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:24:31.996039 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:24:31.997000 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 19 13:24:31.997000 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 19 13:24:31.997000 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 19 13:24:31.997000 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 19 13:24:31.997000 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 13:24:31.997000 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 13:24:31.997000 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 19 13:24:31.997000 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 19 13:24:31.997000 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 19 13:24:31.997000 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:24:31.997000 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 19 13:24:31.997000 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 19 13:24:31.997000 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 19 13:24:31.997000 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi May 19 13:24:31.997000 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:24:31.997000 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi May 19 13:24:31.997000 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:24:31.997000 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:24:31.997000 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:24:31.998236 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:24:31.998236 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:24:31.998236 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:24:31.998236 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:24:31.998236 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 19 13:24:31.998236 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 13:24:31.998236 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 19 13:24:31.998236 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi May 19 13:24:31.998236 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:24:31.998236 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi May 19 13:24:31.998236 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:24:31.998236 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:24:31.998236 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:24:31.998236 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:24:31.998236 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:24:31.998236 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 19 13:24:31.998236 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi May 19 13:24:31.998236 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi [None req-d1cfbe22-906a-4d17-9cbb-235730d6d833 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102943) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:24:31.999477 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: INFO nova.api.openstack.requestlog [None req-d1cfbe22-906a-4d17-9cbb-235730d6d833 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.077244 May 19 13:24:31.999477 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: [pid: 102943|app: 0|req: 23/44] 10.222.0.24 () {60 vars in 1190 bytes} [Thu May 19 13:24:31 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 19 13:24:32.005798 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi [None req-0c4a4fce-20a1-4d2c-9f3c-035d598be081 admin admin] Calling method '>' {{(pid=102944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:24:32.020104 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: INFO nova.api.openstack.requestlog [None req-0c4a4fce-20a1-4d2c-9f3c-035d598be081 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017982 May 19 13:24:32.020639 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: [pid: 102944|app: 0|req: 22/45] 10.222.0.24 () {60 vars in 1210 bytes} [Thu May 19 13:24:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:24:32.030267 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi [None req-afee94ac-cd26-4e30-a854-8506b12a40b8 admin admin] Calling method '>' {{(pid=102943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:24:32.045090 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: INFO nova.api.openstack.requestlog [None req-afee94ac-cd26-4e30-a854-8506b12a40b8 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018346 May 19 13:24:32.045646 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: [pid: 102943|app: 0|req: 24/46] 10.222.0.24 () {60 vars in 1210 bytes} [Thu May 19 13:24:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:24:32.058584 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi [None req-991c5d79-403d-416a-94f1-cf3a2e73c776 admin admin] Calling method '>' {{(pid=102944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:24:32.066846 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: INFO nova.api.openstack.wsgi [None req-991c5d79-403d-416a-94f1-cf3a2e73c776 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 19 13:24:32.069029 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi [None req-991c5d79-403d-416a-94f1-cf3a2e73c776 admin admin] Request method failure captured: May 19 13:24:32.069029 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 19 13:24:32.069029 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: Accept: application/json May 19 13:24:32.069029 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: Accept-Encoding: gzip, deflate May 19 13:24:32.069029 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: Connection: keep-alive May 19 13:24:32.069029 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: Content-Length: 0 May 19 13:24:32.069029 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: Host: 10.222.0.24 May 19 13:24:32.069029 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: Openstack-Api-Version: compute 2.90 May 19 13:24:32.069029 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: Openstack-System-Scope: None May 19 13:24:32.069029 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: User-Agent: python-novaclient May 19 13:24:32.069029 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: X-Auth-Token: gAAAAABihkUP_8Z7hi8ugQ1-iMMpCTyQblZTsSwWZi-6BH7r_uiD30CLFWqfIjKrFIxGPmjPS-9mU43at7qctqQ7haAOHVZYwufvaIDgVAuHOjFNb9r4-9Q1BPQpki4pQFdCJy-eO-om5IMhft9jP8ofm2PXddKYLbFy4JPit1gleWzyXQ0neEA May 19 13:24:32.069029 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: X-Domain-Id: None May 19 13:24:32.069029 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: X-Domain-Name: None May 19 13:24:32.069029 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: X-Identity-Status: Confirmed May 19 13:24:32.069029 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: X-Is-Admin-Project: True May 19 13:24:32.069029 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: X-Openstack-Nova-Api-Version: 2.90 May 19 13:24:32.069029 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: X-Project-Domain-Id: default May 19 13:24:32.069029 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: X-Project-Domain-Name: Default May 19 13:24:32.069029 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: X-Project-Id: 863bcb4c192047ed8ae210a081ac829f May 19 13:24:32.069029 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: X-Project-Name: admin May 19 13:24:32.069029 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: X-Role: admin,reader,member May 19 13:24:32.069029 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: X-Roles: admin,reader,member May 19 13:24:32.070515 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/863bcb4c192047ed8ae210a081ac829f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/863bcb4c192047ed8ae210a081ac829f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_863bcb4c192047ed8ae210a081ac829f", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/863bcb4c192047ed8ae210a081ac829f"}]}] May 19 13:24:32.070515 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: X-Tenant: admin May 19 13:24:32.070515 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: X-Tenant-Id: 863bcb4c192047ed8ae210a081ac829f May 19 13:24:32.070515 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: X-Tenant-Name: admin May 19 13:24:32.070515 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: X-User: admin May 19 13:24:32.070515 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: X-User-Domain-Id: default May 19 13:24:32.070515 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: X-User-Domain-Name: Default May 19 13:24:32.070515 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: X-User-Id: e50c121ca4544e98a148c3b6b1759f0d May 19 13:24:32.070515 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: X-User-Name: admin May 19 13:24:32.070515 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: method: > May 19 13:24:32.070515 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: exception: Flavor 84 could not be found. May 19 13:24:32.070515 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: action_args: {'id': '84'} May 19 13:24:32.070515 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: {{(pid=102944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:24:32.070515 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:24:32.074232 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 19 13:24:32.074232 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 19 13:24:32.074232 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 19 13:24:32.074232 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 19 13:24:32.074232 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 13:24:32.074232 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 13:24:32.074232 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 19 13:24:32.074232 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 19 13:24:32.074232 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 19 13:24:32.074232 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:24:32.074232 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 19 13:24:32.074232 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 19 13:24:32.074232 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 19 13:24:32.074232 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi May 19 13:24:32.074232 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:24:32.074232 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi May 19 13:24:32.074232 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:24:32.074232 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:24:32.074232 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:24:32.075531 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:24:32.075531 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:24:32.075531 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:24:32.075531 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:24:32.075531 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 19 13:24:32.075531 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 13:24:32.075531 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 19 13:24:32.075531 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi May 19 13:24:32.075531 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:24:32.075531 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi May 19 13:24:32.075531 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:24:32.075531 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:24:32.075531 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:24:32.075531 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:24:32.075531 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:24:32.075531 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 19 13:24:32.075531 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi May 19 13:24:32.075531 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi [None req-991c5d79-403d-416a-94f1-cf3a2e73c776 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:24:32.076780 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: INFO nova.api.openstack.requestlog [None req-991c5d79-403d-416a-94f1-cf3a2e73c776 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.017430 May 19 13:24:32.076780 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: [pid: 102944|app: 0|req: 23/47] 10.222.0.24 () {60 vars in 1190 bytes} [Thu May 19 13:24:32 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 19 13:24:32.973953 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi [None req-afee94ac-cd26-4e30-a854-8506b12a40b8 admin admin] Calling method '>' {{(pid=102943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:24:32.975016 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: INFO nova.api.openstack.requestlog [None req-afee94ac-cd26-4e30-a854-8506b12a40b8 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001562 May 19 13:24:32.975556 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: [pid: 102943|app: 0|req: 25/48] 10.222.0.24 () {56 vars in 1074 bytes} [Thu May 19 13:24:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:24:33.178575 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi [None req-b6767d16-8577-4be0-8008-072c33c2e91d admin admin] Calling method '>' {{(pid=102944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:24:33.189182 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: INFO nova.api.openstack.wsgi [None req-b6767d16-8577-4be0-8008-072c33c2e91d admin admin] HTTP exception thrown: Flavor 451 could not be found. May 19 13:24:33.191636 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi [None req-b6767d16-8577-4be0-8008-072c33c2e91d admin admin] Request method failure captured: May 19 13:24:33.191636 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 19 13:24:33.191636 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: Accept: application/json May 19 13:24:33.191636 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: Accept-Encoding: gzip, deflate May 19 13:24:33.191636 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: Connection: keep-alive May 19 13:24:33.191636 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: Content-Length: 0 May 19 13:24:33.191636 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: Host: 10.222.0.24 May 19 13:24:33.191636 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: Openstack-Api-Version: compute 2.90 May 19 13:24:33.191636 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: Openstack-System-Scope: None May 19 13:24:33.191636 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: User-Agent: python-novaclient May 19 13:24:33.191636 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: X-Auth-Token: gAAAAABihkUQqZo44p3q7S8DTSguaLruIDubBomhmm3kpVPvV72XnIJZm4AbTClW3BOsI8eVWOYMKGxc2luHNnIZV8TVisPeFlTwE-ERSR21JfCN14PXfYiCqbqal0VhbdJV-koEJ9rQiYT2WH72AfyGT1ChtTKMwhJqq1VVxPsdc2noeCGYX-0 May 19 13:24:33.191636 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: X-Domain-Id: None May 19 13:24:33.191636 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: X-Domain-Name: None May 19 13:24:33.191636 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: X-Identity-Status: Confirmed May 19 13:24:33.191636 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: X-Is-Admin-Project: True May 19 13:24:33.191636 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: X-Openstack-Nova-Api-Version: 2.90 May 19 13:24:33.191636 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: X-Project-Domain-Id: default May 19 13:24:33.191636 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: X-Project-Domain-Name: Default May 19 13:24:33.191636 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: X-Project-Id: 863bcb4c192047ed8ae210a081ac829f May 19 13:24:33.191636 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: X-Project-Name: admin May 19 13:24:33.191636 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: X-Role: admin,reader,member May 19 13:24:33.191636 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: X-Roles: admin,reader,member May 19 13:24:33.193103 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/863bcb4c192047ed8ae210a081ac829f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/863bcb4c192047ed8ae210a081ac829f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_863bcb4c192047ed8ae210a081ac829f", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/863bcb4c192047ed8ae210a081ac829f"}]}] May 19 13:24:33.193103 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: X-Tenant: admin May 19 13:24:33.193103 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: X-Tenant-Id: 863bcb4c192047ed8ae210a081ac829f May 19 13:24:33.193103 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: X-Tenant-Name: admin May 19 13:24:33.193103 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: X-User: admin May 19 13:24:33.193103 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: X-User-Domain-Id: default May 19 13:24:33.193103 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: X-User-Domain-Name: Default May 19 13:24:33.193103 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: X-User-Id: e50c121ca4544e98a148c3b6b1759f0d May 19 13:24:33.193103 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: X-User-Name: admin May 19 13:24:33.193103 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: method: > May 19 13:24:33.193103 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: exception: Flavor 451 could not be found. May 19 13:24:33.193103 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: action_args: {'id': '451'} May 19 13:24:33.193103 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: {{(pid=102944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:24:33.193103 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:24:33.194187 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 19 13:24:33.194187 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 19 13:24:33.194187 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 19 13:24:33.194187 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 19 13:24:33.194187 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 13:24:33.194187 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 13:24:33.194187 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 19 13:24:33.194187 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 19 13:24:33.194187 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 19 13:24:33.194187 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:24:33.194187 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 19 13:24:33.194187 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 19 13:24:33.194187 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 19 13:24:33.194187 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi May 19 13:24:33.194187 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:24:33.194187 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi May 19 13:24:33.194187 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:24:33.194187 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:24:33.194187 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:24:33.195549 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:24:33.195549 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:24:33.195549 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:24:33.195549 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:24:33.195549 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 19 13:24:33.195549 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 13:24:33.195549 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 19 13:24:33.195549 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi May 19 13:24:33.195549 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:24:33.195549 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi May 19 13:24:33.195549 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:24:33.195549 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:24:33.195549 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:24:33.195549 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:24:33.195549 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:24:33.195549 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 19 13:24:33.195549 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: ERROR nova.api.openstack.wsgi May 19 13:24:33.195549 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi [None req-b6767d16-8577-4be0-8008-072c33c2e91d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:24:33.196920 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: INFO nova.api.openstack.requestlog [None req-b6767d16-8577-4be0-8008-072c33c2e91d admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.077748 May 19 13:24:33.196920 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: [pid: 102944|app: 0|req: 24/49] 10.222.0.24 () {60 vars in 1193 bytes} [Thu May 19 13:24:33 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 19 13:24:33.203312 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi [None req-01a865a5-4b74-470d-9e73-15439d98f6e4 admin admin] Calling method '>' {{(pid=102943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:24:33.219271 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: INFO nova.api.openstack.requestlog [None req-01a865a5-4b74-470d-9e73-15439d98f6e4 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019192 May 19 13:24:33.219793 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: [pid: 102943|app: 0|req: 26/50] 10.222.0.24 () {60 vars in 1210 bytes} [Thu May 19 13:24:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:24:33.229248 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi [None req-96215017-1acc-42ed-acea-38178ae50b67 admin admin] Calling method '>' {{(pid=102944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:24:33.243407 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: INFO nova.api.openstack.requestlog [None req-96215017-1acc-42ed-acea-38178ae50b67 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017643 May 19 13:24:33.243944 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: [pid: 102944|app: 0|req: 25/51] 10.222.0.24 () {60 vars in 1210 bytes} [Thu May 19 13:24:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:24:33.253620 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi [None req-fad76cdd-b22e-46a9-bde8-8877f1290609 admin admin] Calling method '>' {{(pid=102943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:24:33.259727 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: INFO nova.api.openstack.wsgi [None req-fad76cdd-b22e-46a9-bde8-8877f1290609 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 19 13:24:33.261207 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi [None req-fad76cdd-b22e-46a9-bde8-8877f1290609 admin admin] Request method failure captured: May 19 13:24:33.261207 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 19 13:24:33.261207 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: Accept: application/json May 19 13:24:33.261207 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: Accept-Encoding: gzip, deflate May 19 13:24:33.261207 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: Connection: keep-alive May 19 13:24:33.261207 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: Content-Length: 0 May 19 13:24:33.261207 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: Host: 10.222.0.24 May 19 13:24:33.261207 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: Openstack-Api-Version: compute 2.90 May 19 13:24:33.261207 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: Openstack-System-Scope: None May 19 13:24:33.261207 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: User-Agent: python-novaclient May 19 13:24:33.261207 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: X-Auth-Token: gAAAAABihkUQqZo44p3q7S8DTSguaLruIDubBomhmm3kpVPvV72XnIJZm4AbTClW3BOsI8eVWOYMKGxc2luHNnIZV8TVisPeFlTwE-ERSR21JfCN14PXfYiCqbqal0VhbdJV-koEJ9rQiYT2WH72AfyGT1ChtTKMwhJqq1VVxPsdc2noeCGYX-0 May 19 13:24:33.261207 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: X-Domain-Id: None May 19 13:24:33.261207 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: X-Domain-Name: None May 19 13:24:33.261207 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: X-Identity-Status: Confirmed May 19 13:24:33.261207 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: X-Is-Admin-Project: True May 19 13:24:33.261207 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: X-Openstack-Nova-Api-Version: 2.90 May 19 13:24:33.261207 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: X-Project-Domain-Id: default May 19 13:24:33.261207 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: X-Project-Domain-Name: Default May 19 13:24:33.261207 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: X-Project-Id: 863bcb4c192047ed8ae210a081ac829f May 19 13:24:33.261207 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: X-Project-Name: admin May 19 13:24:33.261207 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: X-Role: admin,reader,member May 19 13:24:33.261207 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: X-Roles: admin,reader,member May 19 13:24:33.262741 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/863bcb4c192047ed8ae210a081ac829f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/863bcb4c192047ed8ae210a081ac829f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_863bcb4c192047ed8ae210a081ac829f", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/863bcb4c192047ed8ae210a081ac829f"}]}] May 19 13:24:33.262741 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: X-Tenant: admin May 19 13:24:33.262741 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: X-Tenant-Id: 863bcb4c192047ed8ae210a081ac829f May 19 13:24:33.262741 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: X-Tenant-Name: admin May 19 13:24:33.262741 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: X-User: admin May 19 13:24:33.262741 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: X-User-Domain-Id: default May 19 13:24:33.262741 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: X-User-Domain-Name: Default May 19 13:24:33.262741 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: X-User-Id: e50c121ca4544e98a148c3b6b1759f0d May 19 13:24:33.262741 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: X-User-Name: admin May 19 13:24:33.262741 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: method: > May 19 13:24:33.262741 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: exception: Flavor 451 could not be found. May 19 13:24:33.262741 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: action_args: {'id': '451'} May 19 13:24:33.262741 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: {{(pid=102943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:24:33.262741 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:24:33.263761 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 19 13:24:33.263761 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 19 13:24:33.263761 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 19 13:24:33.263761 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 19 13:24:33.263761 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 13:24:33.263761 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 13:24:33.263761 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 19 13:24:33.263761 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 19 13:24:33.263761 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 19 13:24:33.263761 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:24:33.263761 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 19 13:24:33.263761 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 19 13:24:33.263761 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 19 13:24:33.263761 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi May 19 13:24:33.263761 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:24:33.263761 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi May 19 13:24:33.263761 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:24:33.263761 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:24:33.263761 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:24:33.265162 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:24:33.265162 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:24:33.265162 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:24:33.265162 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:24:33.265162 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 19 13:24:33.265162 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 13:24:33.265162 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 19 13:24:33.265162 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi May 19 13:24:33.265162 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:24:33.265162 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi May 19 13:24:33.265162 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:24:33.265162 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:24:33.265162 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:24:33.265162 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:24:33.265162 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:24:33.265162 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 19 13:24:33.265162 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: ERROR nova.api.openstack.wsgi May 19 13:24:33.265162 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi [None req-fad76cdd-b22e-46a9-bde8-8877f1290609 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102943) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:24:33.266544 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: INFO nova.api.openstack.requestlog [None req-fad76cdd-b22e-46a9-bde8-8877f1290609 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012644 May 19 13:24:33.266544 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: [pid: 102943|app: 0|req: 27/52] 10.222.0.24 () {60 vars in 1193 bytes} [Thu May 19 13:24:33 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 19 13:24:34.138688 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi [None req-96215017-1acc-42ed-acea-38178ae50b67 admin admin] Calling method '>' {{(pid=102944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:24:34.139700 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: INFO nova.api.openstack.requestlog [None req-96215017-1acc-42ed-acea-38178ae50b67 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 May 19 13:24:34.140099 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: [pid: 102944|app: 0|req: 26/53] 10.222.0.24 () {56 vars in 1074 bytes} [Thu May 19 13:24:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 13:24:34.336758 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi [None req-473c16aa-ce5c-47ac-8bf6-20be3e2adb1b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:24:34.357931 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: INFO nova.api.openstack.requestlog [None req-473c16aa-ce5c-47ac-8bf6-20be3e2adb1b admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.082999 May 19 13:24:34.358399 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: [pid: 102943|app: 0|req: 28/54] 10.222.0.24 () {64 vars in 1235 bytes} [Thu May 19 13:24:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 19 13:24:35.270165 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi [None req-96215017-1acc-42ed-acea-38178ae50b67 admin admin] Calling method '>' {{(pid=102944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:24:35.271181 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: INFO nova.api.openstack.requestlog [None req-96215017-1acc-42ed-acea-38178ae50b67 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 May 19 13:24:35.271579 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: [pid: 102944|app: 0|req: 27/55] 10.222.0.24 () {56 vars in 1074 bytes} [Thu May 19 13:24:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:24:35.481271 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi [None req-f107ba7a-dde7-4ac1-ad4b-c2a5f9dbc567 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:24:35.501090 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: INFO nova.api.openstack.requestlog [None req-f107ba7a-dde7-4ac1-ad4b-c2a5f9dbc567 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.084595 May 19 13:24:35.501662 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: [pid: 102943|app: 0|req: 29/56] 10.222.0.24 () {64 vars in 1235 bytes} [Thu May 19 13:24:35 2022] POST /compute/v2.1/flavors => generated 405 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 13:24:36.400775 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi [None req-96215017-1acc-42ed-acea-38178ae50b67 admin admin] Calling method '>' {{(pid=102944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:24:36.402133 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: INFO nova.api.openstack.requestlog [None req-96215017-1acc-42ed-acea-38178ae50b67 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002050 May 19 13:24:36.402681 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: [pid: 102944|app: 0|req: 28/57] 10.222.0.24 () {56 vars in 1074 bytes} [Thu May 19 13:24:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:24:36.605785 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi [None req-7338babb-d74d-4b8c-8073-f85c0f91f2f8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:24:36.625340 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: INFO nova.api.openstack.requestlog [None req-7338babb-d74d-4b8c-8073-f85c0f91f2f8 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.077290 May 19 13:24:36.625910 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: [pid: 102943|app: 0|req: 30/58] 10.222.0.24 () {64 vars in 1235 bytes} [Thu May 19 13:24:36 2022] POST /compute/v2.1/flavors => generated 407 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 13:24:37.510768 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi [None req-96215017-1acc-42ed-acea-38178ae50b67 admin admin] Calling method '>' {{(pid=102944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:24:37.511789 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: INFO nova.api.openstack.requestlog [None req-96215017-1acc-42ed-acea-38178ae50b67 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 May 19 13:24:37.512193 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: [pid: 102944|app: 0|req: 29/59] 10.222.0.24 () {56 vars in 1074 bytes} [Thu May 19 13:24:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:24:37.715558 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi [None req-d803d912-cbf9-43ef-a8ca-a9cdd072ce66 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:24:37.742588 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: INFO nova.api.openstack.requestlog [None req-d803d912-cbf9-43ef-a8ca-a9cdd072ce66 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.092943 May 19 13:24:37.743115 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: [pid: 102943|app: 0|req: 31/60] 10.222.0.24 () {64 vars in 1235 bytes} [Thu May 19 13:24:37 2022] POST /compute/v2.1/flavors => generated 409 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 13:24:38.625174 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi [None req-96215017-1acc-42ed-acea-38178ae50b67 admin admin] Calling method '>' {{(pid=102944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:24:38.626266 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: INFO nova.api.openstack.requestlog [None req-96215017-1acc-42ed-acea-38178ae50b67 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001531 May 19 13:24:38.626836 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: [pid: 102944|app: 0|req: 30/61] 10.222.0.24 () {56 vars in 1074 bytes} [Thu May 19 13:24:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 13:24:38.860197 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi [None req-3f80e63d-467e-4402-a490-20a3d5ccb417 admin admin] Calling method '>' {{(pid=102943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:24:38.879325 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: INFO nova.api.openstack.requestlog [None req-3f80e63d-467e-4402-a490-20a3d5ccb417 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.083856 May 19 13:24:38.879844 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: [pid: 102943|app: 0|req: 32/62] 10.222.0.24 () {60 vars in 1202 bytes} [Thu May 19 13:24:38 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:25:41.278638 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi [None req-96215017-1acc-42ed-acea-38178ae50b67 admin admin] Calling method '>' {{(pid=102944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:25:41.279645 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: INFO nova.api.openstack.requestlog [None req-96215017-1acc-42ed-acea-38178ae50b67 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 May 19 13:25:41.280230 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: [pid: 102944|app: 0|req: 31/63] 10.222.0.24 () {54 vars in 930 bytes} [Thu May 19 13:25:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:25:41.288121 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG dbcounter [-] [102943] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=102943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:25:41.350562 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi [None req-f35e5f0b-c1c9-4415-9b7a-1da11601e890 admin admin] Calling method '>' {{(pid=102943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:25:41.378157 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: INFO nova.api.openstack.requestlog [None req-f35e5f0b-c1c9-4415-9b7a-1da11601e890 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.091367 May 19 13:25:41.378892 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: [pid: 102943|app: 0|req: 33/64] 10.222.0.24 () {60 vars in 1291 bytes} [Thu May 19 13:25:41 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:25:41.401376 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG dbcounter [-] [102944] Writing DB stats nova_api:SELECT=14 {{(pid=102944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:25:41.405493 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi [None req-cd347233-e646-4cc8-bc92-b4593f863acc admin admin] Calling method '>' {{(pid=102944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:25:41.414801 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: INFO nova.api.openstack.requestlog [None req-cd347233-e646-4cc8-bc92-b4593f863acc admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014781 May 19 13:25:41.415664 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: [pid: 102944|app: 0|req: 32/65] 10.222.0.24 () {60 vars in 1282 bytes} [Thu May 19 13:25:41 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:25:41.431257 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi [None req-6bbe58bc-816c-4b9b-ad10-ddc4012ee39c admin admin] Calling method '>' {{(pid=102943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:25:41.445259 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: INFO nova.api.openstack.requestlog [None req-6bbe58bc-816c-4b9b-ad10-ddc4012ee39c admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.017805 May 19 13:25:41.445844 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: [pid: 102943|app: 0|req: 34/66] 10.222.0.24 () {60 vars in 1285 bytes} [Thu May 19 13:25:41 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:25:41.458725 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi [None req-fc8d5b2e-aec2-47e0-b5df-72cef9d5f0b4 admin admin] Calling method '>' {{(pid=102944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:25:41.469455 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: INFO nova.api.openstack.requestlog [None req-fc8d5b2e-aec2-47e0-b5df-72cef9d5f0b4 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014811 May 19 13:25:41.470448 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: [pid: 102944|app: 0|req: 33/67] 10.222.0.24 () {60 vars in 1285 bytes} [Thu May 19 13:25:41 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:25:41.483728 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi [None req-686c4aa5-5ecc-4176-8a16-0187e5f77cac admin admin] Calling method '>' {{(pid=102943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:25:41.493837 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: INFO nova.api.openstack.requestlog [None req-686c4aa5-5ecc-4176-8a16-0187e5f77cac admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013493 May 19 13:25:41.494432 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: [pid: 102943|app: 0|req: 35/68] 10.222.0.24 () {60 vars in 1282 bytes} [Thu May 19 13:25:41 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:29:16.711030 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi [None req-fc8d5b2e-aec2-47e0-b5df-72cef9d5f0b4 admin admin] Calling method '>' {{(pid=102944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:29:16.712312 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: INFO nova.api.openstack.requestlog [None req-fc8d5b2e-aec2-47e0-b5df-72cef9d5f0b4 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002028 May 19 13:29:16.712805 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: [pid: 102944|app: 0|req: 34/69] 10.222.0.24 () {56 vars in 1074 bytes} [Thu May 19 13:29:16 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:29:16.874917 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG dbcounter [-] [102943] Writing DB stats nova_api:SELECT=6 {{(pid=102943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:29:17.000671 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi [None req-6f848185-ebe6-4ae5-865a-db2dcddd9149 admin admin] Calling method '>' {{(pid=102943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:29:17.001958 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 13:29:17.001958 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: warnings.warn(msg) May 19 13:29:17.003620 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG oslo_concurrency.lockutils [None req-6f848185-ebe6-4ae5-865a-db2dcddd9149 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102943) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:29:17.004068 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG oslo_concurrency.lockutils [None req-6f848185-ebe6-4ae5-865a-db2dcddd9149 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102943) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:29:17.004889 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG oslo_concurrency.lockutils [None req-6f848185-ebe6-4ae5-865a-db2dcddd9149 admin admin] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102943) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:29:17.005320 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG oslo_concurrency.lockutils [None req-6f848185-ebe6-4ae5-865a-db2dcddd9149 admin admin] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102943) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:29:17.039667 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: INFO nova.api.openstack.requestlog [None req-6f848185-ebe6-4ae5-865a-db2dcddd9149 admin admin] 10.222.0.24 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.167664 May 19 13:29:17.040529 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: [pid: 102943|app: 0|req: 36/70] 10.222.0.24 () {60 vars in 1193 bytes} [Thu May 19 13:29:16 2022] GET /compute/v2.1/os-services => generated 791 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 13:29:17.969968 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi [None req-fc8d5b2e-aec2-47e0-b5df-72cef9d5f0b4 admin admin] Calling method '>' {{(pid=102944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:29:17.971197 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: INFO nova.api.openstack.requestlog [None req-fc8d5b2e-aec2-47e0-b5df-72cef9d5f0b4 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002140 May 19 13:29:17.971693 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: [pid: 102944|app: 0|req: 35/71] 10.222.0.24 () {56 vars in 1074 bytes} [Thu May 19 13:29:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:29:18.178453 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi [None req-47ed100f-1daa-4364-9434-23a55fd00bf3 admin admin] Calling method '>' {{(pid=102943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:29:18.179543 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 13:29:18.179543 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: warnings.warn(msg) May 19 13:29:18.180720 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG oslo_concurrency.lockutils [None req-47ed100f-1daa-4364-9434-23a55fd00bf3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102943) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:29:18.181188 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG oslo_concurrency.lockutils [None req-47ed100f-1daa-4364-9434-23a55fd00bf3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102943) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:29:18.181990 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG oslo_concurrency.lockutils [None req-47ed100f-1daa-4364-9434-23a55fd00bf3 admin admin] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102943) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:29:18.182442 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG oslo_concurrency.lockutils [None req-47ed100f-1daa-4364-9434-23a55fd00bf3 admin admin] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102943) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:29:18.201980 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: INFO nova.api.openstack.requestlog [None req-47ed100f-1daa-4364-9434-23a55fd00bf3 admin admin] 10.222.0.24 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.088336 May 19 13:29:18.202646 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: [pid: 102943|app: 0|req: 37/72] 10.222.0.24 () {60 vars in 1193 bytes} [Thu May 19 13:29:18 2022] GET /compute/v2.1/os-services => generated 791 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 13:29:29.578195 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi [None req-fc8d5b2e-aec2-47e0-b5df-72cef9d5f0b4 admin admin] Calling method '>' {{(pid=102944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:29:29.579214 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: INFO nova.api.openstack.requestlog [None req-fc8d5b2e-aec2-47e0-b5df-72cef9d5f0b4 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 May 19 13:29:29.579618 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: [pid: 102944|app: 0|req: 36/73] 10.222.0.24 () {56 vars in 1074 bytes} [Thu May 19 13:29:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:29:29.729875 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG dbcounter [-] [102943] Writing DB stats nova_cell0:SELECT=4 {{(pid=102943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:29:29.731021 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG dbcounter [-] [102943] Writing DB stats nova_cell1:SELECT=4 {{(pid=102943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:29:29.732020 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG dbcounter [-] [102943] Writing DB stats nova_api:SELECT=8 {{(pid=102943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:29:29.784436 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi [None req-db1eb0b7-3b8f-486b-a982-6ed63e4cdf68 admin admin] Calling method '>' {{(pid=102943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:29:29.785998 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 13:29:29.785998 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: warnings.warn(msg) May 19 13:29:29.786896 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG oslo_concurrency.lockutils [None req-db1eb0b7-3b8f-486b-a982-6ed63e4cdf68 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102943) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:29:29.787331 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG oslo_concurrency.lockutils [None req-db1eb0b7-3b8f-486b-a982-6ed63e4cdf68 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102943) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:29:29.788106 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG oslo_concurrency.lockutils [None req-db1eb0b7-3b8f-486b-a982-6ed63e4cdf68 admin admin] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102943) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:29:29.788530 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG oslo_concurrency.lockutils [None req-db1eb0b7-3b8f-486b-a982-6ed63e4cdf68 admin admin] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102943) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:29:29.813383 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: INFO nova.api.openstack.requestlog [None req-db1eb0b7-3b8f-486b-a982-6ed63e4cdf68 admin admin] 10.222.0.24 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.091988 May 19 13:29:29.813950 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: [pid: 102943|app: 0|req: 38/74] 10.222.0.24 () {60 vars in 1193 bytes} [Thu May 19 13:29:29 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:29:30.718097 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: DEBUG nova.api.openstack.wsgi [None req-fc8d5b2e-aec2-47e0-b5df-72cef9d5f0b4 admin admin] Calling method '>' {{(pid=102944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:29:30.719104 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: INFO nova.api.openstack.requestlog [None req-fc8d5b2e-aec2-47e0-b5df-72cef9d5f0b4 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 May 19 13:29:30.719506 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: [pid: 102944|app: 0|req: 37/75] 10.222.0.24 () {56 vars in 1074 bytes} [Thu May 19 13:29:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:29:30.922525 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG nova.api.openstack.wsgi [None req-506c236d-3efe-4e8b-aef5-f992268e00c3 admin admin] Calling method '>' {{(pid=102943) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:29:30.923689 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 13:29:30.923689 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: warnings.warn(msg) May 19 13:29:30.924879 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG oslo_concurrency.lockutils [None req-506c236d-3efe-4e8b-aef5-f992268e00c3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102943) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:29:30.925320 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG oslo_concurrency.lockutils [None req-506c236d-3efe-4e8b-aef5-f992268e00c3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102943) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:29:30.926162 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG oslo_concurrency.lockutils [None req-506c236d-3efe-4e8b-aef5-f992268e00c3 admin admin] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102943) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:29:30.926784 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: DEBUG oslo_concurrency.lockutils [None req-506c236d-3efe-4e8b-aef5-f992268e00c3 admin admin] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102943) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:29:30.947692 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: INFO nova.api.openstack.requestlog [None req-506c236d-3efe-4e8b-aef5-f992268e00c3 admin admin] 10.222.0.24 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.092007 May 19 13:29:30.948270 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: [pid: 102943|app: 0|req: 39/76] 10.222.0.24 () {60 vars in 1193 bytes} [Thu May 19 13:29:30 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:30:29.279776 dv-cinder-841125-6-iscsi devstack@n-api.service[102942]: Thu May 19 13:30:29 2022 - graceful shutdown triggered... May 19 13:30:29.279862 dv-cinder-841125-6-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 19 13:30:29.281031 dv-cinder-841125-6-iscsi devstack@n-api.service[102943]: Gracefully killing worker 1 (pid: 102943)... May 19 13:30:29.281694 dv-cinder-841125-6-iscsi devstack@n-api.service[102944]: Gracefully killing worker 2 (pid: 102944)... May 19 13:30:30.280923 dv-cinder-841125-6-iscsi devstack@n-api.service[102942]: worker 1 buried after 1 seconds May 19 13:30:30.280923 dv-cinder-841125-6-iscsi devstack@n-api.service[102942]: worker 2 buried after 1 seconds May 19 13:30:30.280923 dv-cinder-841125-6-iscsi devstack@n-api.service[102942]: goodbye to uWSGI. May 19 13:30:30.282504 dv-cinder-841125-6-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 19 13:30:30.283065 dv-cinder-841125-6-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 19 13:30:30.285755 dv-cinder-841125-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 19 13:30:30.298116 dv-cinder-841125-6-iscsi devstack@n-api.service[120411]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 19 13:30:30.322774 dv-cinder-841125-6-iscsi devstack@n-api.service[120411]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 19 13:30:30 2022] *** May 19 13:30:30.322774 dv-cinder-841125-6-iscsi devstack@n-api.service[120411]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 19 13:30:30.322774 dv-cinder-841125-6-iscsi devstack@n-api.service[120411]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 19 13:30:30.322774 dv-cinder-841125-6-iscsi devstack@n-api.service[120411]: nodename: dv-cinder-841125-6-iscsi May 19 13:30:30.322774 dv-cinder-841125-6-iscsi devstack@n-api.service[120411]: machine: x86_64 May 19 13:30:30.322774 dv-cinder-841125-6-iscsi devstack@n-api.service[120411]: clock source: unix May 19 13:30:30.322774 dv-cinder-841125-6-iscsi devstack@n-api.service[120411]: pcre jit disabled May 19 13:30:30.322774 dv-cinder-841125-6-iscsi devstack@n-api.service[120411]: detected number of CPU cores: 4 May 19 13:30:30.322774 dv-cinder-841125-6-iscsi devstack@n-api.service[120411]: current working directory: / May 19 13:30:30.322774 dv-cinder-841125-6-iscsi devstack@n-api.service[120411]: detected binary path: /usr/bin/uwsgi-core May 19 13:30:30.322774 dv-cinder-841125-6-iscsi devstack@n-api.service[120411]: your processes number limit is 47680 May 19 13:30:30.322774 dv-cinder-841125-6-iscsi devstack@n-api.service[120411]: your memory page size is 4096 bytes May 19 13:30:30.322774 dv-cinder-841125-6-iscsi devstack@n-api.service[120411]: detected max file descriptor number: 2048 May 19 13:30:30.322774 dv-cinder-841125-6-iscsi devstack@n-api.service[120411]: lock engine: pthread robust mutexes May 19 13:30:30.323780 dv-cinder-841125-6-iscsi devstack@n-api.service[120411]: thunder lock: enabled May 19 13:30:30.323780 dv-cinder-841125-6-iscsi devstack@n-api.service[120411]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 19 13:30:30.323780 dv-cinder-841125-6-iscsi devstack@n-api.service[120411]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 19 13:30:30.373868 dv-cinder-841125-6-iscsi devstack@n-api.service[120411]: Python main interpreter initialized at 0x560e85b2d9c0 May 19 13:30:30.373868 dv-cinder-841125-6-iscsi devstack@n-api.service[120411]: python threads support enabled May 19 13:30:30.373868 dv-cinder-841125-6-iscsi devstack@n-api.service[120411]: your server socket listen backlog is limited to 100 connections May 19 13:30:30.373868 dv-cinder-841125-6-iscsi devstack@n-api.service[120411]: your mercy for graceful operations on workers is 90 seconds May 19 13:30:30.374409 dv-cinder-841125-6-iscsi devstack@n-api.service[120411]: mapped 403077 bytes (393 KB) for 2 cores May 19 13:30:30.374409 dv-cinder-841125-6-iscsi devstack@n-api.service[120411]: *** Operational MODE: preforking *** May 19 13:30:30.374660 dv-cinder-841125-6-iscsi devstack@n-api.service[120411]: *** uWSGI is running in multiple interpreter mode *** May 19 13:30:30.374660 dv-cinder-841125-6-iscsi devstack@n-api.service[120411]: spawned uWSGI master process (pid: 120411) May 19 13:30:30.374863 dv-cinder-841125-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 19 13:30:30.375738 dv-cinder-841125-6-iscsi devstack@n-api.service[120411]: spawned uWSGI worker 1 (pid: 120471, cores: 1) May 19 13:30:30.375857 dv-cinder-841125-6-iscsi devstack@n-api.service[120411]: spawned uWSGI worker 2 (pid: 120472, cores: 1) May 19 13:30:30.381514 dv-cinder-841125-6-iscsi devstack@n-api.service[120411]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 19 13:30:31.613385 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 19 13:30:31.630936 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 19 13:30:32.470767 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 13:30:32.470767 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: from cryptography.utils import int_from_bytes May 19 13:30:32.471575 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 13:30:32.471575 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: from cryptography.utils import int_from_bytes May 19 13:30:32.476976 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 13:30:32.476976 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: from cryptography.utils import int_from_bytes May 19 13:30:32.477354 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 13:30:32.477354 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: from cryptography.utils import int_from_bytes May 19 13:30:35.048239 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 19 13:30:35.048777 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 19 13:30:35.049047 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 19 13:30:35.049372 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 19 13:30:35.049771 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 19 13:30:35.050135 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.050455 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.050803 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.051087 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.051412 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.051717 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.052064 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.052375 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.052691 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.052924 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.053257 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.053601 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-841125-6-iscsi {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.053900 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.054196 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.054498 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.054803 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.055098 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.055413 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.055795 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.056235 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.057703 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.057703 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.057703 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.057703 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.058022 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.058102 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.058423 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.058730 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.059031 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.059336 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.059726 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-841125-6-iscsi {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.060034 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.060373 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.060681 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.061076 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.061355 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.062122 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.062423 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.062743 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.063046 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.063368 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.063683 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.063993 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.064305 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.064601 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.064902 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.065206 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.065721 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.066016 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.066358 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.066557 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.066858 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.067175 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.067488 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.067802 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.068047 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.068291 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.068601 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.068913 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.069215 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.069546 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.069838 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.070136 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.070432 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.070733 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.071030 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.071326 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.071637 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.071947 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.072269 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.072569 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.072878 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.073271 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.24 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.073541 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.24 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.073846 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.074176 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.074486 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.074788 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.075096 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.075409 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.075713 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.076018 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.076319 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.076629 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.076945 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.077282 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.077551 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.077848 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.078148 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.078457 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.078755 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.079054 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.079353 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.079646 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.079945 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.080245 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.080542 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.080842 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.081139 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.081658 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.081984 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.082292 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.082597 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.082913 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.083231 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.083537 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.083841 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.084143 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.084445 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.084764 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.085068 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.085367 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.085706 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.086017 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.086319 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.086635 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.086937 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.087238 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.087549 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.087845 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.088157 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.088449 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.088750 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.089047 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.089344 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.091571 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.091909 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.092507 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.092507 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.092986 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.093293 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.093699 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.094082 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.094397 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.094708 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.095017 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.095337 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.095677 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.096012 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.096355 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.096666 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.096999 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.097323 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.097666 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.097977 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.098783 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.098783 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.098968 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.099203 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.099505 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.099823 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.100136 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.100461 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.100772 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.101126 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.101472 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.101712 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.102021 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.102342 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.102660 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.102989 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.103303 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.103642 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.103950 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.104275 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.104592 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.104900 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.105207 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.105537 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.105860 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.106189 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.106495 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.106813 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.107120 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.107426 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.107731 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.108036 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.108453 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.108936 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.109260 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.109605 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.109919 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.110232 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.110540 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.110847 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.111155 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.111458 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.111766 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.112068 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.112371 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.112669 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.112989 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.113318 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.113642 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.113979 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.114283 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.114591 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.114897 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.115202 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.115504 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.115815 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.116122 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.116517 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.116734 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.117105 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.117486 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.117747 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.118047 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.118344 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.118653 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.118964 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.119271 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.119575 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.119884 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.120196 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.120503 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.120814 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.121141 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.121493 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.121794 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.122112 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.122430 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.122738 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.123037 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.123343 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.123642 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.124162 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.124357 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.124669 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.124964 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.125263 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.125583 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.125887 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.126182 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.126459 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 19 13:30:35.126943 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.127041 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 19 13:30:35.127141 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.127141 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.127330 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 19 13:30:35.127429 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.127604 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 19 13:30:35.127718 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.127867 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 19 13:30:35.127987 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.128254 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.128358 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.128581 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.128677 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.128902 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.129001 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.129212 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.129312 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.129547 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.129856 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.130163 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.130473 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.130634 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.130791 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.130964 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.131068 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.131296 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.131397 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.131628 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.131733 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.131961 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.132052 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.132229 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.132328 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.132553 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.132647 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.132868 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.132959 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-841125-6-iscsi {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.133174 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.133266 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.133505 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.133602 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.133808 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.133917 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.134127 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.134219 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.134430 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.134522 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.134757 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.134993 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.135084 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.135308 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.135418 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.135658 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.135817 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.135972 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.136131 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.136275 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.136440 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.136577 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.136756 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.136877 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.137096 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.137202 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.137433 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.138747 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.138866 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.138956 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.139052 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.139157 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.139252 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.139345 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.139430 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.139572 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.139678 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.139767 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.139767 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.139939 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.140024 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-841125-6-iscsi {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.141137 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.141261 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.141362 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.141540 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.141643 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.141731 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.141827 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.141827 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.142009 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.142097 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.142191 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.142277 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.142367 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.142460 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.142554 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.142639 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.142722 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.142812 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.142896 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.143083 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.143204 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.143405 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.143530 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.143747 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.143846 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.144046 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.144172 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.144350 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.144452 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.144647 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.144888 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.144989 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.145204 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.145298 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.145547 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.145660 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.145845 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.145961 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.146151 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.146252 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.146455 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.146555 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.146754 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.146853 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.147065 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.147167 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.147378 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.147503 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.147674 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.147783 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.147933 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.148019 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.148206 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.148320 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.148581 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.148672 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.148880 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.148984 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.149172 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.149287 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.149547 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.149652 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.149934 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.150015 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.150304 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.150413 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.150548 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.150755 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.150843 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.151108 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.151198 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.151447 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.151527 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.151766 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.151959 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.152085 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.152426 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.152522 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.152604 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.152709 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.152935 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.153031 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.153268 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.153484 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.24 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.153652 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.153756 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.24 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.153973 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.154083 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.154291 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.154384 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.154609 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.154785 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.154924 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.155104 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.155280 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.155541 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.155801 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.156216 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.156339 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.156438 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.156533 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.156737 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.156839 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.157046 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.157145 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.157374 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.157532 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.157733 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.157863 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.158046 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.158978 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.158978 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.159183 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.159280 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.159374 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.159468 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.159563 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.159656 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.161498 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.161635 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.161730 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.161914 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.162014 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.162111 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.162269 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.162361 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.162463 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.162463 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.162887 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.162977 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.162977 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.163143 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.163229 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.163229 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.163398 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.163555 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.163653 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.163748 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.163841 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.163934 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.164021 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.164113 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.164199 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.164295 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.164389 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.164732 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.164845 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.164934 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.165028 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.165237 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.165342 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.165582 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.166027 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.166225 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.166331 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.166530 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.166624 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.166841 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.166942 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.167156 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.167249 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.167464 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.167589 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.167784 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.167914 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.168095 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.168353 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.168468 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.168870 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.168987 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.169098 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.169193 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.169359 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.169556 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.169716 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.169947 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.170254 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.170560 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.170696 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.171155 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.171280 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.171442 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.171686 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.171780 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.172045 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.172136 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.172354 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.172455 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.172656 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.172897 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.173012 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.173256 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.173463 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.173557 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.173804 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.173897 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.174118 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.174212 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.174427 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.174528 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.174737 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.174828 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:30:35.175051 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.175151 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.175369 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.175461 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.175684 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.175785 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.176102 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.176222 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.176319 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.176407 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.176636 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.176731 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.176951 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.177067 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.177266 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.177364 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.177633 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.177734 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.177962 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.178064 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.178278 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.178481 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.178586 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.178995 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.179124 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.179215 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.179300 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.179506 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.179610 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.179835 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.179939 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.180155 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.180247 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.180465 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.180563 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.180774 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.180875 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.181090 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.181189 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.181451 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.181599 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.181757 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.181928 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.182085 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.182343 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.182436 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.182658 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.182757 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.182967 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.183067 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.183281 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.183381 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.183598 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.183702 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.183904 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.184221 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.184313 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.184533 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.184624 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.184839 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.184931 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.185145 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.185238 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.185639 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.185761 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.185852 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.185937 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.186068 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.186162 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.186395 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.186498 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.186813 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.186906 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.187639 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.187761 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.187858 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.187954 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.188051 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.189649 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.189771 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.189875 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.189975 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.190074 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.190162 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.190248 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.190333 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.190426 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.190527 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.190615 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.190707 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.190807 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.190900 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.190997 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.191096 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.191183 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.191267 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.191352 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.191352 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.191508 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.191655 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.191743 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.191882 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.192043 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.192197 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.192505 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.193218 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.193341 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.193455 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.193534 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.193620 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.193696 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.193781 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.193933 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.194091 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.194297 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.194390 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.194608 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.194710 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.194928 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.195020 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.195250 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.195349 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.195565 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.195659 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.195879 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.195981 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.196182 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.196281 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.196486 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.196585 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.196800 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.196893 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.197105 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.197195 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.197433 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.197528 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.197745 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.197849 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.198048 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.198157 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.198430 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.198534 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.198679 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.198822 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.198989 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.199249 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.199349 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.199577 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.199876 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.200021 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.200183 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.200349 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.200497 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.200636 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.200776 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.200923 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.201076 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.201214 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.201369 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.201561 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.201698 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.201835 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.202065 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.202442 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.202596 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.202967 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.203107 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.203284 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.203432 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.203598 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.203737 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.203906 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.204044 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.204214 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.204366 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.204509 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.204693 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.204831 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.205017 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.205170 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.205307 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.205473 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.205795 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.205946 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.206111 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.206259 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.206397 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.206536 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.206684 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.206833 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.206970 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.207130 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.207268 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.207404 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.207541 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.207677 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.207825 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.207974 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.208069 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.208342 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.208446 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.208660 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.208787 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.208961 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.209070 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.209323 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.209478 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.209669 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.209774 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.209996 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.210111 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.210461 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.210568 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.210655 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.210873 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.211008 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.211259 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.211373 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.211508 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.211641 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.211823 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.211979 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.212136 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.212282 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.212460 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.212612 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.212773 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.212920 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.213094 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.213242 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.213423 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.213752 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.214065 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.214385 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.214845 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.214959 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.215048 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.215148 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.215368 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.215470 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.215705 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.215798 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.216020 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.216122 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.216339 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.216440 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.216652 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.217053 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.217169 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.217323 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.217489 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.217583 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.217702 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.218914 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.219077 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.219077 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.219245 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.219340 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.219427 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.219522 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.219621 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.219716 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.219803 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.219803 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.219950 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.220129 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.220246 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.220443 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.220554 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.220714 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.220806 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.221024 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.221129 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.221550 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.221664 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.221664 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.221848 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.221993 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.222087 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.222299 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.222392 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.222645 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.222748 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.222929 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.223038 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.223240 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.223334 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.223565 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.223764 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.223982 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.224076 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.224306 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.224407 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.224618 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.224711 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.225048 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.225148 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.225282 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.225364 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.225611 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.225790 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.225916 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.226010 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.226225 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.226324 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.226533 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.226647 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.226830 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.226931 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.227132 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.227224 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.227435 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.227542 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.227745 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.227836 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.228055 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.228149 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.228361 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.228465 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.228663 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.228856 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.228973 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.229187 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.229371 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.229674 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.229818 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.229988 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.230145 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.230330 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.230444 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.230629 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.230741 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.230926 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.231026 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.231232 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.231340 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.231554 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.231658 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.231859 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.231951 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.232165 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.232268 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.232469 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.232562 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.232784 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.232893 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.233109 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.233220 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.234201 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.234316 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.234406 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.234510 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.234609 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.234698 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.234792 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.234907 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.235013 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.235386 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.235501 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.235599 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.235938 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.236160 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.236475 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.236790 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.237002 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.237096 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.237694 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.243832 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.243832 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.244035 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.244136 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.244225 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.244320 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.244417 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.244511 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.244611 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.244698 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.244783 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.244868 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.244962 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.244962 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.245127 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.245214 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.245299 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.245387 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.245494 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.245595 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.245692 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.245780 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.245867 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.245953 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.246038 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.246132 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.246219 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.246312 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.246397 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.246494 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.246580 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.246680 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.246780 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.246870 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.246950 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.247045 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.247132 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.247217 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.247306 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.247399 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.247496 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.247584 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.247677 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.247763 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.247848 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.247940 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.248034 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.248123 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.248209 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.248209 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.248365 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.248459 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.248558 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.248645 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.248645 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.248645 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.248909 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.249026 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.249203 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.249323 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.249552 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.249658 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.249742 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.249824 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.249912 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.249998 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.250079 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.250172 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.250172 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.250323 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.250411 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.250496 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.250496 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.250661 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.250755 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.250849 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.250937 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.251021 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.251108 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.251193 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.251368 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.251486 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.251649 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.251743 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.251990 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.252091 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.252305 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.252399 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.252612 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.252705 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.252921 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.253015 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.253228 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.253322 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.253632 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.253887 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.253978 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.254077 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.254176 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.254266 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.254466 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.254569 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.254778 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.254888 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.255123 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.255230 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.255429 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.257525 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.257652 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.257755 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.257844 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.257929 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.258004 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.258076 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.258149 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.258231 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.258312 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.258385 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.258458 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.258529 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.258608 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.258692 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.258765 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.258842 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.258916 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.258987 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.259072 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.259158 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.259239 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.259312 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.260352 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.260352 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.260352 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.260589 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.260843 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.261040 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.261124 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.261366 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.261488 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.261691 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.261859 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.262021 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.262177 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.262267 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.262486 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.262582 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.262813 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.262923 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.263141 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.263234 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.263450 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.263549 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.263762 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.263857 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.264085 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.264176 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.264404 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.264603 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.264764 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.264916 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.265113 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.265338 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.265472 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.265770 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.266105 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.266320 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.266483 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.266646 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.266805 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.266966 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.267132 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.267283 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.267440 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.267591 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.267740 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.267906 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.268075 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.268226 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.268382 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.268535 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.268684 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.268849 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.269009 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.269166 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.269325 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.269501 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.269653 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.269815 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.269973 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.270142 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.270291 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.270448 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.270597 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.270760 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.270918 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.271070 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.271228 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.271386 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.271544 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.271694 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.271843 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.272089 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.272344 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.272511 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.272669 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.272913 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.273078 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.273239 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.273390 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.273568 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.273732 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.273732 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.274263 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.274419 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.274588 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.274739 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.275005 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.275162 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.275320 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.275471 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.275621 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.275779 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.275930 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.276088 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.276237 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.276387 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.276535 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.276759 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.276916 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.276916 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.277262 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.277516 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.277685 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.277850 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.278008 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.278171 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.278338 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.278503 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.278661 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.278831 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.279001 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.279158 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.279315 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.279473 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.279632 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.279632 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.279926 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.280082 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.280261 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.280413 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.280576 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.280736 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.280893 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.281054 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.281202 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.281359 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.281542 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.281695 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.281695 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.281979 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.282133 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.282285 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.282532 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.282698 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.282848 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.283094 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.283249 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.283408 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.283408 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.283709 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.283858 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.284157 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.284396 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.284635 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.284959 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.285273 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.285581 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.285744 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.286053 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.286455 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.286626 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.286844 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.287118 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.287345 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.287345 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.287658 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.287808 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.287959 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.288107 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.288264 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.288459 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.288623 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.288871 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.289028 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.289187 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.295634 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.295989 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.296300 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.296648 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.296648 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.296648 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.297554 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.297929 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.298306 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.298623 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.298921 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.299282 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.299282 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.299868 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.300161 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.300494 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.300738 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.300738 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.300738 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.300738 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.301815 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.302071 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.302365 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.302594 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.303060 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.303465 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.303711 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.304013 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.304523 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.304846 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.305154 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.305600 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.305836 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.305836 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.306383 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.306673 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.306986 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.307217 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.307516 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.307821 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.308063 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.308474 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.308474 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.309056 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.309360 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.309870 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.310136 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.310437 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.310752 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.310993 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.311300 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.311596 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.311755 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.311962 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.312171 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.312171 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.312513 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.312679 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.312908 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.313197 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.313380 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.313668 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.313824 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.314022 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.314194 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.314417 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.314417 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.314982 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.315204 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.315367 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.315581 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.315780 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.316061 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.316229 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.316434 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.316598 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.316811 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.316966 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.317127 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.317385 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.317636 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.317809 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.317961 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.318111 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.318318 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.318480 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.318636 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.318924 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.318924 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.319267 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.319422 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.319571 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.319781 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.319944 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.320095 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.320288 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.320441 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.320663 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.320831 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.320983 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.321183 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.321346 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.321533 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.321739 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.321907 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.322058 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.322261 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.322425 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.322630 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.322802 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.322971 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.323180 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.323403 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.323726 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.323883 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.324034 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.324034 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.324385 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.324606 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.324917 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.325153 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.325372 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.325582 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.325733 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.325936 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.326191 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.326405 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.326572 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.326734 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.326734 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.327134 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.327134 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.327455 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.327616 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.327834 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.327998 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.328323 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.328323 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.328787 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.328952 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.329104 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.329340 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.329518 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.329681 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.329898 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.330053 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.330203 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.330466 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.330631 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.330838 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.331001 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.331153 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.331395 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.331551 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.331753 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.331910 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.332276 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.332518 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.332681 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.333727 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.333988 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.334259 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.334427 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.334587 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.334793 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.335107 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.335450 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.335618 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.335828 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.335991 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.336143 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.336500 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.336712 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.336894 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.337054 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.337295 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.337517 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.337674 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.337875 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.338044 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.338197 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.338348 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.338586 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.338809 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.339057 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.339282 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.339447 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.339744 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.339908 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.340114 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.340280 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.340519 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.340683 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.340891 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.341054 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.341306 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.341567 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.341725 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.341889 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.342040 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.342283 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.342439 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.342700 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.343068 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.343302 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.343686 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.344040 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.344454 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.344689 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.344846 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.345258 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.345535 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.345764 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.345930 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.346177 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.346404 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.346404 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.346799 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.347038 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.347257 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.347413 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.347649 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.347804 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.348031 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.348193 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.348438 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.348593 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.348593 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.348963 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.349206 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.349370 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.349635 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.349791 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.350029 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.350184 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.350392 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.350566 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.350831 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.351042 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.351205 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.351440 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.351649 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.351813 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.352004 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.352190 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.352400 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 19 13:30:35.352555 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.352555 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.352555 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.352555 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.352555 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.352555 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.352555 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.353865 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.353865 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.353865 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.353865 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.353865 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.353865 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.353865 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.353865 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.355878 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.355878 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.355878 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.355878 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.355878 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.355878 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.355878 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.355878 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.357522 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.357522 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.357522 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.357522 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.357522 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.357522 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.357522 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.357522 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.359449 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.359449 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.359449 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.359449 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.359449 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.359449 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.359449 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.359449 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.361033 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.361033 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.361033 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.361033 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.361033 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.361033 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.361033 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.361033 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.362412 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.362412 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.362412 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.362412 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.362412 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.362412 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.362412 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.362412 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.363862 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.363862 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.363862 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.363862 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.363862 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.363862 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.363862 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.363862 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.365788 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.365788 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.365788 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.365788 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.365788 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.365788 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.365788 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.365788 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.367363 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.367363 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.367363 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.367363 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.367363 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.367363 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.367363 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.367363 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.368656 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.368656 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.368656 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.368656 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.368656 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.368656 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.368656 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.368656 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.369816 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.369816 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.369816 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.369816 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.369816 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.369816 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.369816 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.369816 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.370967 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.370967 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.370967 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.370967 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.370967 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.370967 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.370967 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.370967 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.372107 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.372107 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.372107 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.372107 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.372107 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.372107 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.372107 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.373115 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.373115 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.373115 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.373593 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.373753 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.374025 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.374552 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.374966 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.375303 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.375721 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.375935 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.376248 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.376552 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.376875 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.377281 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.377805 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.378140 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.378467 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.378790 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.379153 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.379463 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.379778 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.380055 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.380389 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.380706 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.381052 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.381373 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.382020 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.382332 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.382783 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.383103 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.383409 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.383755 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.384065 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.384441 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.384877 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.385128 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.385491 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.386008 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.386362 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.386362 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.386807 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.387055 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.387276 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.387568 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.387893 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.388187 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.388510 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.388757 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.389066 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.389385 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.390091 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.390655 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.390972 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.391293 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.391625 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.391946 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.392275 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.392588 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.392905 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.393215 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.393594 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.393968 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.394199 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.394703 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.395068 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.395319 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.395551 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO dbcounter [None req-5a411aef-96dd-4399-bca1-4348adce8acd None None] Registered counter for database nova_api May 19 13:30:35.396083 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.396083 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.396637 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.396637 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.397112 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.397112 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.397775 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.397775 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.398253 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.398486 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.398718 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.399012 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.399307 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.399626 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.399944 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.400295 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.400563 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.400903 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.401190 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.401542 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.401868 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.402188 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.402512 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.402824 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.403127 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.403457 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.403809 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.404127 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.404464 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.404794 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.405143 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.405767 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.406144 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:30:35.406313 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 19 13:30:35.418560 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_db.sqlalchemy.engines [None req-5a411aef-96dd-4399-bca1-4348adce8acd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120472) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 13:30:35.426620 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writer thread running {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 13:30:35.470205 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO dbcounter [None req-09f40f02-df67-4d1c-97cd-8e0002e53243 None None] Registered counter for database nova_api May 19 13:30:35.485490 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.context [None req-5a411aef-96dd-4399-bca1-4348adce8acd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5bd426f0-9e44-4ba7-83d1-d4a29b25b071(cell1) {{(pid=120472) load_cells /opt/stack/nova/nova/context.py:464}} May 19 13:30:35.490904 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-5a411aef-96dd-4399-bca1-4348adce8acd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:30:35.493535 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_db.sqlalchemy.engines [None req-09f40f02-df67-4d1c-97cd-8e0002e53243 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120471) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 13:30:35.494058 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-5a411aef-96dd-4399-bca1-4348adce8acd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:30:35.495067 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-5a411aef-96dd-4399-bca1-4348adce8acd None None] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:30:35.497234 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-5a411aef-96dd-4399-bca1-4348adce8acd None None] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:30:35.499501 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO dbcounter [None req-5a411aef-96dd-4399-bca1-4348adce8acd None None] Registered counter for database nova_cell0 May 19 13:30:35.503072 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writer thread running {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 13:30:35.504266 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO dbcounter [None req-5a411aef-96dd-4399-bca1-4348adce8acd None None] Registered counter for database nova_cell1 May 19 13:30:35.518875 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_db.sqlalchemy.engines [None req-5a411aef-96dd-4399-bca1-4348adce8acd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120472) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 13:30:35.531889 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_db.sqlalchemy.engines [None req-5a411aef-96dd-4399-bca1-4348adce8acd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120472) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 13:30:35.533344 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writer thread running {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 13:30:35.570864 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.context [None req-09f40f02-df67-4d1c-97cd-8e0002e53243 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5bd426f0-9e44-4ba7-83d1-d4a29b25b071(cell1) {{(pid=120471) load_cells /opt/stack/nova/nova/context.py:464}} May 19 13:30:35.575293 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-09f40f02-df67-4d1c-97cd-8e0002e53243 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:30:35.576886 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-09f40f02-df67-4d1c-97cd-8e0002e53243 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:30:35.578315 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-09f40f02-df67-4d1c-97cd-8e0002e53243 None None] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:30:35.580472 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-09f40f02-df67-4d1c-97cd-8e0002e53243 None None] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:30:35.582739 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO dbcounter [None req-09f40f02-df67-4d1c-97cd-8e0002e53243 None None] Registered counter for database nova_cell0 May 19 13:30:35.587128 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO dbcounter [None req-09f40f02-df67-4d1c-97cd-8e0002e53243 None None] Registered counter for database nova_cell1 May 19 13:30:35.595644 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_db.sqlalchemy.engines [None req-09f40f02-df67-4d1c-97cd-8e0002e53243 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120471) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 13:30:35.601001 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writer thread running {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 13:30:35.720414 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writer thread running {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 13:30:35.730142 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO dbcounter [None req-5a411aef-96dd-4399-bca1-4348adce8acd None None] Registered counter for database nova_cell0 May 19 13:30:35.737367 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_db.sqlalchemy.engines [None req-5a411aef-96dd-4399-bca1-4348adce8acd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120472) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 13:30:35.741986 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writer thread running {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 13:30:35.763909 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_db.sqlalchemy.engines [None req-09f40f02-df67-4d1c-97cd-8e0002e53243 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120471) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 13:30:35.770128 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writer thread running {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 13:30:35.781178 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO dbcounter [None req-09f40f02-df67-4d1c-97cd-8e0002e53243 None None] Registered counter for database nova_cell0 May 19 13:30:35.791961 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_db.sqlalchemy.engines [None req-09f40f02-df67-4d1c-97cd-8e0002e53243 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120471) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 13:30:35.797819 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writer thread running {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 13:30:36.114072 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: WARNING keystonemiddleware.auth_token [None req-5a411aef-96dd-4399-bca1-4348adce8acd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 19 13:30:36.122727 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: WARNING keystonemiddleware.auth_token [None req-5a411aef-96dd-4399-bca1-4348adce8acd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 19 13:30:36.163636 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: WARNING keystonemiddleware.auth_token [None req-09f40f02-df67-4d1c-97cd-8e0002e53243 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 19 13:30:36.173528 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: WARNING keystonemiddleware.auth_token [None req-09f40f02-df67-4d1c-97cd-8e0002e53243 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 19 13:30:36.489487 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: WARNING keystonemiddleware.auth_token [None req-5a411aef-96dd-4399-bca1-4348adce8acd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 19 13:30:36.495698 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: WARNING keystonemiddleware.auth_token [None req-5a411aef-96dd-4399-bca1-4348adce8acd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 19 13:30:36.501031 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560e85b2d9c0 pid: 120472 (default app) May 19 13:30:36.543972 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: WARNING keystonemiddleware.auth_token [None req-09f40f02-df67-4d1c-97cd-8e0002e53243 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 19 13:30:36.550895 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: WARNING keystonemiddleware.auth_token [None req-09f40f02-df67-4d1c-97cd-8e0002e53243 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 19 13:30:36.556087 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560e85b2d9c0 pid: 120471 (default app) May 19 13:31:17.395973 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_api:SELECT=3 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:31:17.397120 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_cell1:SELECT=3 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:31:17.398372 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_cell0:SELECT=3 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:31:17.399379 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_cell0:SELECT=3 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:31:18.315758 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_api:SELECT=3 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:31:18.316672 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_cell1:SELECT=3 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:31:18.319650 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_cell0:SELECT=3 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:31:18.324038 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_cell0:SELECT=3 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:31:19.141597 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-83948769-3f65-4c76-963e-40e80c480194 tempest-VolumesNegativeTest-1616521136 tempest-VolumesNegativeTest-1616521136-project] Action: 'create', calling method: .version_select at 0x7f7c2c651550>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-804761501", "metadata": {"Type": "work"}}} {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:31:19.164058 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-83948769-3f65-4c76-963e-40e80c480194 tempest-VolumesNegativeTest-1616521136 tempest-VolumesNegativeTest-1616521136-project] Request method failure captured: May 19 13:31:19.164058 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 19 13:31:19.164058 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Accept: application/json May 19 13:31:19.164058 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Accept-Encoding: identity May 19 13:31:19.164058 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Connection: close May 19 13:31:19.164058 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Content-Length: 121 May 19 13:31:19.164058 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Content-Type: application/json May 19 13:31:19.164058 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Host: 10.222.0.24 May 19 13:31:19.164058 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Openstack-System-Scope: None May 19 13:31:19.164058 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: User-Agent: python-urllib3/1.26.9 May 19 13:31:19.164058 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Auth-Token: gAAAAABihkaljHFkhuqm1pc7-A-qmvjypfFBPzSI-fnlYmDwAdwL9H5gjLMF8_8f4hiDDBhxtvqKU5P8IIEJ5Gu9wXGsY3GAsQN1DhU8JMPMPmgKUlZ_QJWlUUgqDp6C_L3Dnhwo0E_5Rcq_hGucjjUFALZuwuTePpTxt8hSikaX3kxg5x4m8h0 May 19 13:31:19.164058 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Domain-Id: None May 19 13:31:19.164058 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Domain-Name: None May 19 13:31:19.164058 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Identity-Status: Confirmed May 19 13:31:19.164058 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Is-Admin-Project: True May 19 13:31:19.164058 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Domain-Id: default May 19 13:31:19.164058 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Domain-Name: Default May 19 13:31:19.164058 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Id: 7269a91653d744c7a56d2188f1d10ab5 May 19 13:31:19.164058 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Name: tempest-VolumesNegativeTest-1616521136 May 19 13:31:19.164058 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Role: reader,member May 19 13:31:19.164058 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Roles: reader,member May 19 13:31:19.165482 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/7269a91653d744c7a56d2188f1d10ab5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/7269a91653d744c7a56d2188f1d10ab5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_7269a91653d744c7a56d2188f1d10ab5", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/7269a91653d744c7a56d2188f1d10ab5"}]}] May 19 13:31:19.165482 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant: tempest-VolumesNegativeTest-1616521136 May 19 13:31:19.165482 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant-Id: 7269a91653d744c7a56d2188f1d10ab5 May 19 13:31:19.165482 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant-Name: tempest-VolumesNegativeTest-1616521136 May 19 13:31:19.165482 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User: tempest-VolumesNegativeTest-1616521136-project May 19 13:31:19.165482 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Domain-Id: default May 19 13:31:19.165482 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Domain-Name: Default May 19 13:31:19.165482 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Id: 946fa7f26f644b58bce754c95e4298ec May 19 13:31:19.165482 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Name: tempest-VolumesNegativeTest-1616521136-project May 19 13:31:19.165482 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: May 19 13:31:19.165482 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-804761501", "metadata": {"Type": "work"}}} May 19 13:31:19.165482 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: method: May 19 13:31:19.165482 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 19 13:31:19.166641 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-804761501', 'metadata': {'Type': 'work'}}}} May 19 13:31:19.166641 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:31:19.166641 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:31:19.166641 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 13:31:19.166641 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 13:31:19.166641 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 13:31:19.166641 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise error May 19 13:31:19.166641 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 19 13:31:19.166641 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:31:19.166641 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 19 13:31:19.166641 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 19 13:31:19.166641 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:31:19.166641 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi On instance['volume']: May 19 13:31:19.166641 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi '#$%' May 19 13:31:19.166641 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:31:19.166641 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:31:19.166641 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:31:19.166641 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:31:19.166641 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:31:19.166641 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:31:19.166641 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:31:19.166641 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:31:19.168203 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 13:31:19.168203 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 13:31:19.168203 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:31:19.168203 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:31:19.168203 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 13:31:19.168203 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 13:31:19.168203 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 13:31:19.168203 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 13:31:19.168203 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 13:31:19.168203 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 13:31:19.168203 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 19 13:31:19.168203 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:31:19.168203 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:31:19.168203 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:31:19.168203 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:31:19.168203 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:31:19.168203 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:31:19.168203 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 13:31:19.168203 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 13:31:19.171410 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 19 13:31:19.171410 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:31:19.172684 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-83948769-3f65-4c76-963e-40e80c480194 tempest-VolumesNegativeTest-1616521136 tempest-VolumesNegativeTest-1616521136-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:31:19.173899 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-83948769-3f65-4c76-963e-40e80c480194 tempest-VolumesNegativeTest-1616521136 tempest-VolumesNegativeTest-1616521136-project] 10.222.0.24 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.789894 May 19 13:31:19.179912 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 1/1] 10.222.0.24 () {60 vars in 1155 bytes} [Thu May 19 13:31:17 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1797 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 13:31:19.186343 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-18c2d332-7512-46d0-917b-5499492cd537 tempest-VolumesNegativeTest-1616521136 tempest-VolumesNegativeTest-1616521136-project] Action: 'create', calling method: .version_select at 0x7f7c2c59c8b0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-276958230", "metadata": {"Type": "work"}}} {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:31:19.193111 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-18c2d332-7512-46d0-917b-5499492cd537 tempest-VolumesNegativeTest-1616521136 tempest-VolumesNegativeTest-1616521136-project] Request method failure captured: May 19 13:31:19.193111 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 19 13:31:19.193111 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Accept: application/json May 19 13:31:19.193111 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Accept-Encoding: identity May 19 13:31:19.193111 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Connection: close May 19 13:31:19.193111 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Content-Length: 119 May 19 13:31:19.193111 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Content-Type: application/json May 19 13:31:19.193111 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Host: 10.222.0.24 May 19 13:31:19.193111 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Openstack-System-Scope: None May 19 13:31:19.193111 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: User-Agent: python-urllib3/1.26.9 May 19 13:31:19.193111 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Auth-Token: gAAAAABihkaljHFkhuqm1pc7-A-qmvjypfFBPzSI-fnlYmDwAdwL9H5gjLMF8_8f4hiDDBhxtvqKU5P8IIEJ5Gu9wXGsY3GAsQN1DhU8JMPMPmgKUlZ_QJWlUUgqDp6C_L3Dnhwo0E_5Rcq_hGucjjUFALZuwuTePpTxt8hSikaX3kxg5x4m8h0 May 19 13:31:19.193111 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Domain-Id: None May 19 13:31:19.193111 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Domain-Name: None May 19 13:31:19.193111 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Identity-Status: Confirmed May 19 13:31:19.193111 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Is-Admin-Project: True May 19 13:31:19.193111 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Domain-Id: default May 19 13:31:19.193111 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Domain-Name: Default May 19 13:31:19.193111 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Id: 7269a91653d744c7a56d2188f1d10ab5 May 19 13:31:19.193111 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Name: tempest-VolumesNegativeTest-1616521136 May 19 13:31:19.193111 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Role: reader,member May 19 13:31:19.193111 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Roles: reader,member May 19 13:31:19.194735 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/7269a91653d744c7a56d2188f1d10ab5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/7269a91653d744c7a56d2188f1d10ab5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_7269a91653d744c7a56d2188f1d10ab5", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/7269a91653d744c7a56d2188f1d10ab5"}]}] May 19 13:31:19.194735 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant: tempest-VolumesNegativeTest-1616521136 May 19 13:31:19.194735 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant-Id: 7269a91653d744c7a56d2188f1d10ab5 May 19 13:31:19.194735 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant-Name: tempest-VolumesNegativeTest-1616521136 May 19 13:31:19.194735 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User: tempest-VolumesNegativeTest-1616521136-project May 19 13:31:19.194735 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Domain-Id: default May 19 13:31:19.194735 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Domain-Name: Default May 19 13:31:19.194735 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Id: 946fa7f26f644b58bce754c95e4298ec May 19 13:31:19.194735 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Name: tempest-VolumesNegativeTest-1616521136-project May 19 13:31:19.194735 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: May 19 13:31:19.194735 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-276958230", "metadata": {"Type": "work"}}} May 19 13:31:19.194735 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: method: May 19 13:31:19.194735 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 19 13:31:19.195497 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-276958230', 'metadata': {'Type': 'work'}}}} May 19 13:31:19.195497 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:31:19.195497 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:31:19.195497 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 13:31:19.195497 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 13:31:19.195497 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 13:31:19.195497 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise error May 19 13:31:19.195497 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 19 13:31:19.195497 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:31:19.195497 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 19 13:31:19.195497 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 19 13:31:19.195497 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:31:19.195497 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi On instance['volume']: May 19 13:31:19.195497 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi '0' May 19 13:31:19.195497 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:31:19.195497 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:31:19.195497 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:31:19.195497 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:31:19.195497 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:31:19.195497 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:31:19.195497 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:31:19.195497 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:31:19.196812 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 13:31:19.196812 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 13:31:19.196812 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:31:19.196812 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:31:19.196812 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 13:31:19.196812 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 13:31:19.196812 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 13:31:19.196812 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 13:31:19.196812 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 13:31:19.196812 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 13:31:19.196812 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 19 13:31:19.196812 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:31:19.196812 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:31:19.196812 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:31:19.196812 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:31:19.196812 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:31:19.196812 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:31:19.196812 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 13:31:19.196812 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 13:31:19.197985 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 19 13:31:19.197985 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:31:19.203614 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-18c2d332-7512-46d0-917b-5499492cd537 tempest-VolumesNegativeTest-1616521136 tempest-VolumesNegativeTest-1616521136-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:31:19.204531 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-18c2d332-7512-46d0-917b-5499492cd537 tempest-VolumesNegativeTest-1616521136 tempest-VolumesNegativeTest-1616521136-project] 10.222.0.24 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.023220 May 19 13:31:19.212377 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 2/2] 10.222.0.24 () {60 vars in 1155 bytes} [Thu May 19 13:31:19 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 13:31:19.219238 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-7a56dfe9-3868-4b8b-b0f3-44b47c82958c tempest-VolumesNegativeTest-1616521136 tempest-VolumesNegativeTest-1616521136-project] Action: 'create', calling method: .version_select at 0x7f7c2c6518b0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1319503648", "metadata": {"Type": "work"}}} {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:31:19.229840 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-7a56dfe9-3868-4b8b-b0f3-44b47c82958c tempest-VolumesNegativeTest-1616521136 tempest-VolumesNegativeTest-1616521136-project] Request method failure captured: May 19 13:31:19.229840 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 19 13:31:19.229840 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Accept: application/json May 19 13:31:19.229840 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Accept-Encoding: identity May 19 13:31:19.229840 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Connection: close May 19 13:31:19.229840 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Content-Length: 119 May 19 13:31:19.229840 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Content-Type: application/json May 19 13:31:19.229840 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Host: 10.222.0.24 May 19 13:31:19.229840 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Openstack-System-Scope: None May 19 13:31:19.229840 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: User-Agent: python-urllib3/1.26.9 May 19 13:31:19.229840 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Auth-Token: gAAAAABihkaljHFkhuqm1pc7-A-qmvjypfFBPzSI-fnlYmDwAdwL9H5gjLMF8_8f4hiDDBhxtvqKU5P8IIEJ5Gu9wXGsY3GAsQN1DhU8JMPMPmgKUlZ_QJWlUUgqDp6C_L3Dnhwo0E_5Rcq_hGucjjUFALZuwuTePpTxt8hSikaX3kxg5x4m8h0 May 19 13:31:19.229840 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Domain-Id: None May 19 13:31:19.229840 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Domain-Name: None May 19 13:31:19.229840 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Identity-Status: Confirmed May 19 13:31:19.229840 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Is-Admin-Project: True May 19 13:31:19.229840 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Domain-Id: default May 19 13:31:19.229840 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Domain-Name: Default May 19 13:31:19.229840 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Id: 7269a91653d744c7a56d2188f1d10ab5 May 19 13:31:19.229840 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Name: tempest-VolumesNegativeTest-1616521136 May 19 13:31:19.229840 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Role: reader,member May 19 13:31:19.229840 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Roles: reader,member May 19 13:31:19.231895 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/7269a91653d744c7a56d2188f1d10ab5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/7269a91653d744c7a56d2188f1d10ab5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_7269a91653d744c7a56d2188f1d10ab5", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/7269a91653d744c7a56d2188f1d10ab5"}]}] May 19 13:31:19.231895 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant: tempest-VolumesNegativeTest-1616521136 May 19 13:31:19.231895 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant-Id: 7269a91653d744c7a56d2188f1d10ab5 May 19 13:31:19.231895 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant-Name: tempest-VolumesNegativeTest-1616521136 May 19 13:31:19.231895 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User: tempest-VolumesNegativeTest-1616521136-project May 19 13:31:19.231895 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Domain-Id: default May 19 13:31:19.231895 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Domain-Name: Default May 19 13:31:19.231895 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Id: 946fa7f26f644b58bce754c95e4298ec May 19 13:31:19.231895 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Name: tempest-VolumesNegativeTest-1616521136-project May 19 13:31:19.231895 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: May 19 13:31:19.231895 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1319503648", "metadata": {"Type": "work"}}} May 19 13:31:19.231895 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: method: May 19 13:31:19.231895 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 19 13:31:19.233330 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1319503648', 'metadata': {'Type': 'work'}}}} May 19 13:31:19.233330 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:31:19.233330 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:31:19.233330 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 13:31:19.233330 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 13:31:19.233330 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 13:31:19.233330 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise error May 19 13:31:19.233330 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 19 13:31:19.233330 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:31:19.233330 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 19 13:31:19.233330 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 19 13:31:19.233330 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:31:19.233330 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi On instance['volume']: May 19 13:31:19.233330 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi '' May 19 13:31:19.233330 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:31:19.233330 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:31:19.233330 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:31:19.233330 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:31:19.233330 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:31:19.233330 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:31:19.233330 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:31:19.233330 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:31:19.235068 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 13:31:19.235068 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 13:31:19.235068 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:31:19.235068 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:31:19.235068 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 13:31:19.235068 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 13:31:19.235068 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 13:31:19.235068 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 13:31:19.235068 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 13:31:19.235068 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 13:31:19.235068 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 19 13:31:19.235068 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:31:19.235068 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:31:19.235068 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:31:19.235068 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:31:19.235068 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:31:19.235068 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:31:19.235068 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 13:31:19.235068 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 13:31:19.236396 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 19 13:31:19.236396 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:31:19.236396 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-7a56dfe9-3868-4b8b-b0f3-44b47c82958c tempest-VolumesNegativeTest-1616521136 tempest-VolumesNegativeTest-1616521136-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:31:19.236396 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-7a56dfe9-3868-4b8b-b0f3-44b47c82958c tempest-VolumesNegativeTest-1616521136 tempest-VolumesNegativeTest-1616521136-project] 10.222.0.24 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.020119 May 19 13:31:19.240145 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 3/3] 10.222.0.24 () {60 vars in 1155 bytes} [Thu May 19 13:31:19 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 13:31:19.256482 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-bd0e4321-9af9-4788-8e0b-7130901c1a1e tempest-VolumesNegativeTest-1616521136 tempest-VolumesNegativeTest-1616521136-project] Calling method '.version_select at 0x7f7c2c57d5e0>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:31:19.812642 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-178207ad-e7ea-4e0a-91f9-14d4e3c068b3 tempest-VolumesSnapshotsTestJSON-1266838011 tempest-VolumesSnapshotsTestJSON-1266838011-project] Action: 'create', calling method: .version_select at 0x7f7c2c6544c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-452339364"}} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:31:20.180038 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.wsgi [None req-bd0e4321-9af9-4788-8e0b-7130901c1a1e tempest-VolumesNegativeTest-1616521136 tempest-VolumesNegativeTest-1616521136-project] HTTP exception thrown: Volume tempest-invalid-2038572001 could not be found. May 19 13:31:20.184867 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-bd0e4321-9af9-4788-8e0b-7130901c1a1e tempest-VolumesNegativeTest-1616521136 tempest-VolumesNegativeTest-1616521136-project] Request method failure captured: May 19 13:31:20.184867 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-2038572001 HTTP/1.1 May 19 13:31:20.184867 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Accept: application/json May 19 13:31:20.184867 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Accept-Encoding: identity May 19 13:31:20.184867 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Connection: close May 19 13:31:20.184867 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Content-Length: 0 May 19 13:31:20.184867 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Content-Type: application/json May 19 13:31:20.184867 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Host: 10.222.0.24 May 19 13:31:20.184867 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Openstack-System-Scope: None May 19 13:31:20.184867 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: User-Agent: python-urllib3/1.26.9 May 19 13:31:20.184867 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Auth-Token: gAAAAABihkaljHFkhuqm1pc7-A-qmvjypfFBPzSI-fnlYmDwAdwL9H5gjLMF8_8f4hiDDBhxtvqKU5P8IIEJ5Gu9wXGsY3GAsQN1DhU8JMPMPmgKUlZ_QJWlUUgqDp6C_L3Dnhwo0E_5Rcq_hGucjjUFALZuwuTePpTxt8hSikaX3kxg5x4m8h0 May 19 13:31:20.184867 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Domain-Id: None May 19 13:31:20.184867 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Domain-Name: None May 19 13:31:20.184867 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Identity-Status: Confirmed May 19 13:31:20.184867 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Is-Admin-Project: True May 19 13:31:20.184867 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Domain-Id: default May 19 13:31:20.184867 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Domain-Name: Default May 19 13:31:20.184867 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Id: 7269a91653d744c7a56d2188f1d10ab5 May 19 13:31:20.184867 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Name: tempest-VolumesNegativeTest-1616521136 May 19 13:31:20.184867 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Role: reader,member May 19 13:31:20.184867 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Roles: reader,member May 19 13:31:20.187881 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/7269a91653d744c7a56d2188f1d10ab5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/7269a91653d744c7a56d2188f1d10ab5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_7269a91653d744c7a56d2188f1d10ab5", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/7269a91653d744c7a56d2188f1d10ab5"}]}] May 19 13:31:20.187881 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant: tempest-VolumesNegativeTest-1616521136 May 19 13:31:20.187881 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant-Id: 7269a91653d744c7a56d2188f1d10ab5 May 19 13:31:20.187881 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant-Name: tempest-VolumesNegativeTest-1616521136 May 19 13:31:20.187881 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User: tempest-VolumesNegativeTest-1616521136-project May 19 13:31:20.187881 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Domain-Id: default May 19 13:31:20.187881 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Domain-Name: Default May 19 13:31:20.187881 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Id: 946fa7f26f644b58bce754c95e4298ec May 19 13:31:20.187881 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Name: tempest-VolumesNegativeTest-1616521136-project May 19 13:31:20.187881 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: method: May 19 13:31:20.187881 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: exception: Volume tempest-invalid-2038572001 could not be found. May 19 13:31:20.187881 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: action_args: {'id': 'tempest-invalid-2038572001'} May 19 13:31:20.187881 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:31:20.188665 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:31:20.188665 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 13:31:20.188665 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 13:31:20.188665 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 19 13:31:20.188665 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 19 13:31:20.188665 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 19 13:31:20.188665 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 19 13:31:20.188665 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 19 13:31:20.188665 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 19 13:31:20.188665 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 19 13:31:20.188665 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 19 13:31:20.188665 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 13:31:20.188665 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 13:31:20.188665 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 13:31:20.188665 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 13:31:20.188665 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-2038572001 could not be found. (HTTP 404) (Request-ID: req-d779488a-31ad-44f5-b952-9293020d2c5d) May 19 13:31:20.188665 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:31:20.188665 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:31:20.188665 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:31:20.190914 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:31:20.190914 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 19 13:31:20.190914 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 19 13:31:20.190914 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 19 13:31:20.190914 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 19 13:31:20.190914 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 19 13:31:20.190914 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 19 13:31:20.190914 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 19 13:31:20.190914 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 19 13:31:20.190914 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 13:31:20.190914 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 13:31:20.190914 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 19 13:31:20.190914 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 19 13:31:20.190914 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 19 13:31:20.190914 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 19 13:31:20.190914 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 19 13:31:20.190914 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 19 13:31:20.190914 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 19 13:31:20.190914 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 19 13:31:20.192370 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 13:31:20.192370 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 13:31:20.192370 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 13:31:20.192370 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 13:31:20.192370 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-2038572001 could not be found. May 19 13:31:20.192370 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:31:20.192370 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:31:20.192370 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:31:20.192370 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:31:20.192370 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:31:20.192370 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:31:20.192370 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:31:20.192370 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:31:20.192370 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 13:31:20.192370 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 13:31:20.192370 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:31:20.192370 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:31:20.192370 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 19 13:31:20.192370 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 13:31:20.192370 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-2038572001 could not be found. May 19 13:31:20.193581 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:31:20.193581 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:31:20.193581 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:31:20.193581 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:31:20.193581 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:31:20.193581 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:31:20.193581 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:31:20.193581 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:31:20.193581 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-2038572001 could not be found. May 19 13:31:20.193581 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:31:20.197034 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-bd0e4321-9af9-4788-8e0b-7130901c1a1e tempest-VolumesNegativeTest-1616521136 tempest-VolumesNegativeTest-1616521136-project] Returning 404 to user: Volume tempest-invalid-2038572001 could not be found. {{(pid=120472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:31:20.198397 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-bd0e4321-9af9-4788-8e0b-7130901c1a1e tempest-VolumesNegativeTest-1616521136 tempest-VolumesNegativeTest-1616521136-project] 10.222.0.24 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2038572001" status: 404 len: 99 microversion: 2.1 time: 0.950566 May 19 13:31:20.205609 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 4/4] 10.222.0.24 () {58 vars in 1217 bytes} [Thu May 19 13:31:19 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-2038572001 => generated 99 bytes in 958 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 19 13:31:20.218367 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-ac469c8d-f549-4286-be24-7f2e5795cb35 tempest-VolumesNegativeTest-1616521136 tempest-VolumesNegativeTest-1616521136-project] 10.222.0.24 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.011194 May 19 13:31:20.222159 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 5/5] 10.222.0.24 () {58 vars in 1139 bytes} [Thu May 19 13:31:20 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 16 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 19 13:31:20.234606 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-2c947013-fae1-435c-8f53-be8e4e855e5b tempest-VolumesNegativeTest-1616521136 tempest-VolumesNegativeTest-1616521136-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003931 May 19 13:31:20.235940 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 6/6] 10.222.0.24 () {58 vars in 1136 bytes} [Thu May 19 13:31:20 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 19 13:31:20.244502 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-7d6f91ae-1e42-42e3-9299-05d06ebc8811 tempest-VolumesNegativeTest-1616521136 tempest-VolumesNegativeTest-1616521136-project] Calling method '.version_select at 0x7f7c2c4ac9d0>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:31:20.313575 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.wsgi [None req-7d6f91ae-1e42-42e3-9299-05d06ebc8811 tempest-VolumesNegativeTest-1616521136 tempest-VolumesNegativeTest-1616521136-project] HTTP exception thrown: Volume d8a5cd5f-ccf7-4b9a-b5e8-4ff90a5926e1 could not be found. May 19 13:31:20.316862 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-7d6f91ae-1e42-42e3-9299-05d06ebc8811 tempest-VolumesNegativeTest-1616521136 tempest-VolumesNegativeTest-1616521136-project] Request method failure captured: May 19 13:31:20.316862 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: request: DELETE /compute/v2.1/os-volumes/d8a5cd5f-ccf7-4b9a-b5e8-4ff90a5926e1 HTTP/1.1 May 19 13:31:20.316862 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Accept: application/json May 19 13:31:20.316862 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Accept-Encoding: identity May 19 13:31:20.316862 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Connection: close May 19 13:31:20.316862 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Content-Length: 0 May 19 13:31:20.316862 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Content-Type: application/json May 19 13:31:20.316862 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Host: 10.222.0.24 May 19 13:31:20.316862 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Openstack-System-Scope: None May 19 13:31:20.316862 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: User-Agent: python-urllib3/1.26.9 May 19 13:31:20.316862 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Auth-Token: gAAAAABihkaljHFkhuqm1pc7-A-qmvjypfFBPzSI-fnlYmDwAdwL9H5gjLMF8_8f4hiDDBhxtvqKU5P8IIEJ5Gu9wXGsY3GAsQN1DhU8JMPMPmgKUlZ_QJWlUUgqDp6C_L3Dnhwo0E_5Rcq_hGucjjUFALZuwuTePpTxt8hSikaX3kxg5x4m8h0 May 19 13:31:20.316862 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Domain-Id: None May 19 13:31:20.316862 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Domain-Name: None May 19 13:31:20.316862 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Identity-Status: Confirmed May 19 13:31:20.316862 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Is-Admin-Project: True May 19 13:31:20.316862 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Domain-Id: default May 19 13:31:20.316862 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Domain-Name: Default May 19 13:31:20.316862 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Id: 7269a91653d744c7a56d2188f1d10ab5 May 19 13:31:20.316862 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Name: tempest-VolumesNegativeTest-1616521136 May 19 13:31:20.316862 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Role: reader,member May 19 13:31:20.316862 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Roles: reader,member May 19 13:31:20.318268 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/7269a91653d744c7a56d2188f1d10ab5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/7269a91653d744c7a56d2188f1d10ab5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_7269a91653d744c7a56d2188f1d10ab5", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/7269a91653d744c7a56d2188f1d10ab5"}]}] May 19 13:31:20.318268 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant: tempest-VolumesNegativeTest-1616521136 May 19 13:31:20.318268 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant-Id: 7269a91653d744c7a56d2188f1d10ab5 May 19 13:31:20.318268 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant-Name: tempest-VolumesNegativeTest-1616521136 May 19 13:31:20.318268 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User: tempest-VolumesNegativeTest-1616521136-project May 19 13:31:20.318268 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Domain-Id: default May 19 13:31:20.318268 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Domain-Name: Default May 19 13:31:20.318268 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Id: 946fa7f26f644b58bce754c95e4298ec May 19 13:31:20.318268 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Name: tempest-VolumesNegativeTest-1616521136-project May 19 13:31:20.318268 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: method: May 19 13:31:20.318268 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: exception: Volume d8a5cd5f-ccf7-4b9a-b5e8-4ff90a5926e1 could not be found. May 19 13:31:20.318268 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: action_args: {'id': 'd8a5cd5f-ccf7-4b9a-b5e8-4ff90a5926e1'} May 19 13:31:20.318268 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:31:20.319056 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:31:20.319056 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 13:31:20.319056 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 13:31:20.319056 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 19 13:31:20.319056 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 19 13:31:20.319056 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 19 13:31:20.319056 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 19 13:31:20.319056 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 19 13:31:20.319056 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 19 13:31:20.319056 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 19 13:31:20.319056 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 19 13:31:20.319056 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 13:31:20.319056 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 13:31:20.319056 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 13:31:20.319056 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 13:31:20.319056 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d8a5cd5f-ccf7-4b9a-b5e8-4ff90a5926e1 could not be found. (HTTP 404) (Request-ID: req-c7124c8b-62f9-42a7-b905-77e5d3e6c522) May 19 13:31:20.319056 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:31:20.319056 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:31:20.319056 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:31:20.320810 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:31:20.320810 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 19 13:31:20.320810 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 19 13:31:20.320810 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 19 13:31:20.320810 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 19 13:31:20.320810 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 19 13:31:20.320810 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 19 13:31:20.320810 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 19 13:31:20.320810 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 19 13:31:20.320810 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 13:31:20.320810 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 13:31:20.320810 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 19 13:31:20.320810 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 19 13:31:20.320810 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 19 13:31:20.320810 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 19 13:31:20.320810 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 19 13:31:20.320810 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 19 13:31:20.320810 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 19 13:31:20.320810 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 19 13:31:20.322242 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 13:31:20.322242 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 13:31:20.322242 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 13:31:20.322242 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 13:31:20.322242 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d8a5cd5f-ccf7-4b9a-b5e8-4ff90a5926e1 could not be found. May 19 13:31:20.322242 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:31:20.322242 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:31:20.322242 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:31:20.322242 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:31:20.322242 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:31:20.322242 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:31:20.322242 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:31:20.322242 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:31:20.322242 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 13:31:20.322242 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 13:31:20.322242 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:31:20.322242 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:31:20.322242 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 19 13:31:20.322242 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 13:31:20.323747 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d8a5cd5f-ccf7-4b9a-b5e8-4ff90a5926e1 could not be found. May 19 13:31:20.323747 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:31:20.323747 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:31:20.323747 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:31:20.323747 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:31:20.323747 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:31:20.323747 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:31:20.323747 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:31:20.323747 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:31:20.323747 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d8a5cd5f-ccf7-4b9a-b5e8-4ff90a5926e1 could not be found. May 19 13:31:20.323747 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:31:20.325874 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-7d6f91ae-1e42-42e3-9299-05d06ebc8811 tempest-VolumesNegativeTest-1616521136 tempest-VolumesNegativeTest-1616521136-project] Returning 404 to user: Volume d8a5cd5f-ccf7-4b9a-b5e8-4ff90a5926e1 could not be found. {{(pid=120472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:31:20.327346 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-7d6f91ae-1e42-42e3-9299-05d06ebc8811 tempest-VolumesNegativeTest-1616521136 tempest-VolumesNegativeTest-1616521136-project] 10.222.0.24 "DELETE /compute/v2.1/os-volumes/d8a5cd5f-ccf7-4b9a-b5e8-4ff90a5926e1" status: 404 len: 109 microversion: 2.1 time: 0.086539 May 19 13:31:20.328628 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 7/7] 10.222.0.24 () {58 vars in 1247 bytes} [Thu May 19 13:31:20 2022] DELETE /compute/v2.1/os-volumes/d8a5cd5f-ccf7-4b9a-b5e8-4ff90a5926e1 => generated 109 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 13:31:20.338828 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-3874b915-37c3-449e-835c-3637c80d36f3 tempest-VolumesNegativeTest-1616521136 tempest-VolumesNegativeTest-1616521136-project] Calling method '.version_select at 0x7f7c2c4ace50>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:31:20.375083 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.wsgi [None req-3874b915-37c3-449e-835c-3637c80d36f3 tempest-VolumesNegativeTest-1616521136 tempest-VolumesNegativeTest-1616521136-project] HTTP exception thrown: Volume d63adb52-fee2-4692-88e6-d26bad1b10bb could not be found. May 19 13:31:20.378819 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-3874b915-37c3-449e-835c-3637c80d36f3 tempest-VolumesNegativeTest-1616521136 tempest-VolumesNegativeTest-1616521136-project] Request method failure captured: May 19 13:31:20.378819 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: request: GET /compute/v2.1/os-volumes/d63adb52-fee2-4692-88e6-d26bad1b10bb HTTP/1.1 May 19 13:31:20.378819 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Accept: application/json May 19 13:31:20.378819 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Accept-Encoding: identity May 19 13:31:20.378819 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Connection: close May 19 13:31:20.378819 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Content-Length: 0 May 19 13:31:20.378819 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Content-Type: application/json May 19 13:31:20.378819 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Host: 10.222.0.24 May 19 13:31:20.378819 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Openstack-System-Scope: None May 19 13:31:20.378819 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: User-Agent: python-urllib3/1.26.9 May 19 13:31:20.378819 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Auth-Token: gAAAAABihkaljHFkhuqm1pc7-A-qmvjypfFBPzSI-fnlYmDwAdwL9H5gjLMF8_8f4hiDDBhxtvqKU5P8IIEJ5Gu9wXGsY3GAsQN1DhU8JMPMPmgKUlZ_QJWlUUgqDp6C_L3Dnhwo0E_5Rcq_hGucjjUFALZuwuTePpTxt8hSikaX3kxg5x4m8h0 May 19 13:31:20.378819 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Domain-Id: None May 19 13:31:20.378819 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Domain-Name: None May 19 13:31:20.378819 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Identity-Status: Confirmed May 19 13:31:20.378819 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Is-Admin-Project: True May 19 13:31:20.378819 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Domain-Id: default May 19 13:31:20.378819 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Domain-Name: Default May 19 13:31:20.378819 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Id: 7269a91653d744c7a56d2188f1d10ab5 May 19 13:31:20.378819 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Name: tempest-VolumesNegativeTest-1616521136 May 19 13:31:20.378819 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Role: reader,member May 19 13:31:20.378819 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Roles: reader,member May 19 13:31:20.380472 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/7269a91653d744c7a56d2188f1d10ab5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/7269a91653d744c7a56d2188f1d10ab5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_7269a91653d744c7a56d2188f1d10ab5", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/7269a91653d744c7a56d2188f1d10ab5"}]}] May 19 13:31:20.380472 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant: tempest-VolumesNegativeTest-1616521136 May 19 13:31:20.380472 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant-Id: 7269a91653d744c7a56d2188f1d10ab5 May 19 13:31:20.380472 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant-Name: tempest-VolumesNegativeTest-1616521136 May 19 13:31:20.380472 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User: tempest-VolumesNegativeTest-1616521136-project May 19 13:31:20.380472 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Domain-Id: default May 19 13:31:20.380472 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Domain-Name: Default May 19 13:31:20.380472 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Id: 946fa7f26f644b58bce754c95e4298ec May 19 13:31:20.380472 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Name: tempest-VolumesNegativeTest-1616521136-project May 19 13:31:20.380472 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: method: May 19 13:31:20.380472 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: exception: Volume d63adb52-fee2-4692-88e6-d26bad1b10bb could not be found. May 19 13:31:20.380472 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: action_args: {'id': 'd63adb52-fee2-4692-88e6-d26bad1b10bb'} May 19 13:31:20.380472 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:31:20.381568 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:31:20.381568 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 13:31:20.381568 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 13:31:20.381568 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 19 13:31:20.381568 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi item = cinderclient( May 19 13:31:20.381568 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 19 13:31:20.381568 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 19 13:31:20.381568 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 13:31:20.381568 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 13:31:20.381568 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 13:31:20.381568 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 13:31:20.381568 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 13:31:20.381568 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 13:31:20.381568 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 13:31:20.381568 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 13:31:20.381568 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d63adb52-fee2-4692-88e6-d26bad1b10bb could not be found. (HTTP 404) (Request-ID: req-ed4190ce-7011-4ed6-9667-df8fe1169378) May 19 13:31:20.381568 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:31:20.381568 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:31:20.381568 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:31:20.382969 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:31:20.382969 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 19 13:31:20.382969 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 19 13:31:20.382969 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 19 13:31:20.382969 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 19 13:31:20.382969 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 19 13:31:20.382969 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 19 13:31:20.382969 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 19 13:31:20.382969 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 19 13:31:20.382969 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 13:31:20.382969 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 13:31:20.382969 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 19 13:31:20.382969 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi item = cinderclient( May 19 13:31:20.382969 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 19 13:31:20.382969 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 19 13:31:20.382969 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 13:31:20.382969 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 13:31:20.382969 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 13:31:20.382969 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 13:31:20.384392 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 13:31:20.384392 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 13:31:20.384392 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 13:31:20.384392 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 13:31:20.384392 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d63adb52-fee2-4692-88e6-d26bad1b10bb could not be found. May 19 13:31:20.384392 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:31:20.384392 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:31:20.384392 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:31:20.384392 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:31:20.384392 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:31:20.384392 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:31:20.384392 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:31:20.384392 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:31:20.384392 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 13:31:20.384392 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 13:31:20.384392 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:31:20.384392 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:31:20.384392 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 19 13:31:20.384392 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 13:31:20.385872 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d63adb52-fee2-4692-88e6-d26bad1b10bb could not be found. May 19 13:31:20.385872 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:31:20.385872 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:31:20.385872 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:31:20.385872 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:31:20.385872 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:31:20.385872 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:31:20.385872 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:31:20.385872 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:31:20.385872 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d63adb52-fee2-4692-88e6-d26bad1b10bb could not be found. May 19 13:31:20.385872 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:31:20.387935 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-3874b915-37c3-449e-835c-3637c80d36f3 tempest-VolumesNegativeTest-1616521136 tempest-VolumesNegativeTest-1616521136-project] Returning 404 to user: Volume d63adb52-fee2-4692-88e6-d26bad1b10bb could not be found. {{(pid=120472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:31:20.389059 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-3874b915-37c3-449e-835c-3637c80d36f3 tempest-VolumesNegativeTest-1616521136 tempest-VolumesNegativeTest-1616521136-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/d63adb52-fee2-4692-88e6-d26bad1b10bb" status: 404 len: 109 microversion: 2.1 time: 0.054474 May 19 13:31:20.390160 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 8/8] 10.222.0.24 () {58 vars in 1244 bytes} [Thu May 19 13:31:20 2022] GET /compute/v2.1/os-volumes/d63adb52-fee2-4692-88e6-d26bad1b10bb => generated 109 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 13:31:21.388963 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-b79a45ac-e721-4f04-b6dc-c353380249e0 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1448540979", "imageRef": "9beb860d-9c3f-4244-80aa-71a9c337a429", "flavorRef": "452", "networks": [{"uuid": "15c026e4-2659-4699-ba07-f872724b5304"}]}} {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:31:21.632967 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.network.neutron [None req-b79a45ac-e721-4f04-b6dc-c353380249e0 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] validate_networks() for [('15c026e4-2659-4699-ba07-f872724b5304', None, None, None, None, None)] {{(pid=120472) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 13:31:21.654537 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-178207ad-e7ea-4e0a-91f9-14d4e3c068b3 tempest-VolumesSnapshotsTestJSON-1266838011 tempest-VolumesSnapshotsTestJSON-1266838011-project] 10.222.0.24 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.344447 May 19 13:31:21.655265 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 1/9] 10.222.0.24 () {60 vars in 1154 bytes} [Thu May 19 13:31:18 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3347 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 19 13:31:21.662171 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-819a0067-31e6-4486-9b06-dadd9d0c7eb8 tempest-VolumesTestJSON-983084852 tempest-VolumesTestJSON-983084852-project] Calling method '.version_select at 0x7f7c2c51e4c0>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:31:21.756884 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-819a0067-31e6-4486-9b06-dadd9d0c7eb8 tempest-VolumesTestJSON-983084852 tempest-VolumesTestJSON-983084852-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/d2cafc50-5633-4ce3-927f-b1428a35e638" status: 200 len: 349 microversion: 2.1 time: 0.099812 May 19 13:31:21.757463 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 2/10] 10.222.0.24 () {58 vars in 1244 bytes} [Thu May 19 13:31:21 2022] GET /compute/v2.1/os-volumes/d2cafc50-5633-4ce3-927f-b1428a35e638 => generated 349 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:31:21.768824 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-3a7b0b3f-7672-44d2-a910-a4fc98a0a816 tempest-VolumesSnapshotsTestJSON-1266838011 tempest-VolumesSnapshotsTestJSON-1266838011-project] Calling method '.version_select at 0x7f7c2c51e5e0>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:31:21.949674 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-3a7b0b3f-7672-44d2-a910-a4fc98a0a816 tempest-VolumesSnapshotsTestJSON-1266838011 tempest-VolumesSnapshotsTestJSON-1266838011-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/3c1ddd62-55ba-46fc-b062-c3a625e96962" status: 200 len: 344 microversion: 2.1 time: 0.186238 May 19 13:31:21.950475 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 3/11] 10.222.0.24 () {58 vars in 1244 bytes} [Thu May 19 13:31:21 2022] GET /compute/v2.1/os-volumes/3c1ddd62-55ba-46fc-b062-c3a625e96962 => generated 344 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:31:22.964318 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-5e5ac79a-7d8f-4a63-8358-1dd43cb8c14f tempest-VolumesSnapshotsTestJSON-1266838011 tempest-VolumesSnapshotsTestJSON-1266838011-project] Calling method '.version_select at 0x7f7c2c51eca0>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:31:23.051381 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-5e5ac79a-7d8f-4a63-8358-1dd43cb8c14f tempest-VolumesSnapshotsTestJSON-1266838011 tempest-VolumesSnapshotsTestJSON-1266838011-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/3c1ddd62-55ba-46fc-b062-c3a625e96962" status: 200 len: 345 microversion: 2.1 time: 0.091392 May 19 13:31:23.052118 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 4/12] 10.222.0.24 () {58 vars in 1244 bytes} [Thu May 19 13:31:22 2022] GET /compute/v2.1/os-volumes/3c1ddd62-55ba-46fc-b062-c3a625e96962 => generated 345 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:31:23.064044 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-e94e74bf-d2e4-4c5c-8ee2-1a1cedaa31d0 tempest-VolumesSnapshotsTestJSON-1266838011 tempest-VolumesSnapshotsTestJSON-1266838011-project] Action: 'create', calling method: .version_select at 0x7f7c2c533310>, body: {"snapshot": {"volume_id": "3c1ddd62-55ba-46fc-b062-c3a625e96962", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-861093198"}} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:31:23.507996 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-e94e74bf-d2e4-4c5c-8ee2-1a1cedaa31d0 tempest-VolumesSnapshotsTestJSON-1266838011 tempest-VolumesSnapshotsTestJSON-1266838011-project] 10.222.0.24 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.448447 May 19 13:31:23.508916 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 5/13] 10.222.0.24 () {60 vars in 1161 bytes} [Thu May 19 13:31:23 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 13:31:23.519601 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-8dd55a5b-a4fd-4b85-87f6-c70b8f5d547a tempest-VolumesTestJSON-983084852 tempest-VolumesTestJSON-983084852-project] Calling method '.version_select at 0x7f7c2c51ed30>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:31:23.612944 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-8dd55a5b-a4fd-4b85-87f6-c70b8f5d547a tempest-VolumesTestJSON-983084852 tempest-VolumesTestJSON-983084852-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/7ae21365-a25a-4e56-b329-29c449e470c7" status: 200 len: 350 microversion: 2.1 time: 0.102700 May 19 13:31:23.613538 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 6/14] 10.222.0.24 () {58 vars in 1244 bytes} [Thu May 19 13:31:23 2022] GET /compute/v2.1/os-volumes/7ae21365-a25a-4e56-b329-29c449e470c7 => generated 350 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:31:23.635186 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-0fccb127-c0c1-406e-82ec-d768fe3ee65d tempest-VolumesSnapshotsTestJSON-1266838011 tempest-VolumesSnapshotsTestJSON-1266838011-project] Calling method '.version_select at 0x7f7c2c51e5e0>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:31:23.728721 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-0fccb127-c0c1-406e-82ec-d768fe3ee65d tempest-VolumesSnapshotsTestJSON-1266838011 tempest-VolumesSnapshotsTestJSON-1266838011-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/c2623dfa-aca5-4296-b383-bc0ae13af117" status: 200 len: 286 microversion: 2.1 time: 0.113143 May 19 13:31:23.729622 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 7/15] 10.222.0.24 () {58 vars in 1250 bytes} [Thu May 19 13:31:23 2022] GET /compute/v2.1/os-snapshots/c2623dfa-aca5-4296-b383-bc0ae13af117 => generated 286 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:31:23.740426 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-d04867eb-0f54-48ba-b4a5-27406b3b1ea7 tempest-VolumesSnapshotsTestJSON-1266838011 tempest-VolumesSnapshotsTestJSON-1266838011-project] Calling method '.version_select at 0x7f7c2c5338b0>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:31:23.831997 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-d04867eb-0f54-48ba-b4a5-27406b3b1ea7 tempest-VolumesSnapshotsTestJSON-1266838011 tempest-VolumesSnapshotsTestJSON-1266838011-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.096660 May 19 13:31:23.832564 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 8/16] 10.222.0.24 () {58 vars in 1139 bytes} [Thu May 19 13:31:23 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 13:31:23.847250 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-263a34ea-26e7-4037-a60e-edd6a02ff084 tempest-VolumesSnapshotsTestJSON-1266838011 tempest-VolumesSnapshotsTestJSON-1266838011-project] Calling method '.version_select at 0x7f7c2c51e5e0>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:31:23.893185 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-263a34ea-26e7-4037-a60e-edd6a02ff084 tempest-VolumesSnapshotsTestJSON-1266838011 tempest-VolumesSnapshotsTestJSON-1266838011-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/c2623dfa-aca5-4296-b383-bc0ae13af117" status: 200 len: 286 microversion: 2.1 time: 0.049948 May 19 13:31:23.894229 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 9/17] 10.222.0.24 () {58 vars in 1250 bytes} [Thu May 19 13:31:23 2022] GET /compute/v2.1/os-snapshots/c2623dfa-aca5-4296-b383-bc0ae13af117 => generated 286 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:31:24.485676 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.virt.hardware [None req-b79a45ac-e721-4f04-b6dc-c353380249e0 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Flavor limits 0:0:0 {{(pid=120472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 13:31:24.486879 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.virt.hardware [None req-b79a45ac-e721-4f04-b6dc-c353380249e0 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Image limits 0:0:0 {{(pid=120472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 13:31:24.487497 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.virt.hardware [None req-b79a45ac-e721-4f04-b6dc-c353380249e0 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Flavor pref 0:0:0 {{(pid=120472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 13:31:24.488479 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.virt.hardware [None req-b79a45ac-e721-4f04-b6dc-c353380249e0 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Image pref 0:0:0 {{(pid=120472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 13:31:24.489067 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.virt.hardware [None req-b79a45ac-e721-4f04-b6dc-c353380249e0 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 13:31:24.520444 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-b79a45ac-e721-4f04-b6dc-c353380249e0 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:24.521129 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-b79a45ac-e721-4f04-b6dc-c353380249e0 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:24.522900 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-b79a45ac-e721-4f04-b6dc-c353380249e0 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:24.523722 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-b79a45ac-e721-4f04-b6dc-c353380249e0 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:24.598772 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.quota [None req-b79a45ac-e721-4f04-b6dc-c353380249e0 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Getting quotas for project 40b09e85301c4e349b6714b13ae2e955. Resources: {'instances', 'cores', 'ram'} {{(pid=120472) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 13:31:24.619749 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.quota [None req-b79a45ac-e721-4f04-b6dc-c353380249e0 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Getting quotas for user 52ceb5b9477e431ba4a01adf2f3f485a and project 40b09e85301c4e349b6714b13ae2e955. Resources: {'instances', 'cores', 'ram'} {{(pid=120472) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 13:31:24.647645 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-b79a45ac-e721-4f04-b6dc-c353380249e0 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Going to run 1 instances... {{(pid=120472) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 13:31:24.656038 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-b79a45ac-e721-4f04-b6dc-c353380249e0 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] [instance: 080936a4-151d-4f4b-a750-937d342729db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9beb860d-9c3f-4244-80aa-71a9c337a429',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120472) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 13:31:24.845979 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-b79a45ac-e721-4f04-b6dc-c353380249e0 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.803154 May 19 13:31:24.847031 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 9/18] 10.222.0.24 () {60 vars in 1146 bytes} [Thu May 19 13:31:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 3805 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 19 13:31:24.857966 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-a30fead0-10b5-41b6-9f95-1d7d06c2f27e tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:31:24.859408 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-a30fead0-10b5-41b6-9f95-1d7d06c2f27e tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] [instance: 080936a4-151d-4f4b-a750-937d342729db] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:31:24.910028 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-a1fe13cd-d4c7-44ef-98d1-dce69a7ba2c6 tempest-VolumesSnapshotsTestJSON-1266838011 tempest-VolumesSnapshotsTestJSON-1266838011-project] Calling method '.version_select at 0x7f7c2c3b55e0>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:31:24.996232 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-a1fe13cd-d4c7-44ef-98d1-dce69a7ba2c6 tempest-VolumesSnapshotsTestJSON-1266838011 tempest-VolumesSnapshotsTestJSON-1266838011-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/c2623dfa-aca5-4296-b383-bc0ae13af117" status: 200 len: 286 microversion: 2.1 time: 0.093424 May 19 13:31:24.997544 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 10/19] 10.222.0.24 () {58 vars in 1250 bytes} [Thu May 19 13:31:24 2022] GET /compute/v2.1/os-snapshots/c2623dfa-aca5-4296-b383-bc0ae13af117 => generated 286 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:31:25.116813 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-a30fead0-10b5-41b6-9f95-1d7d06c2f27e tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ceb5b9477e431ba4a01adf2f3f485a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b09e85301c4e349b6714b13ae2e955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:31:25.153907 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-a30fead0-10b5-41b6-9f95-1d7d06c2f27e tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] 10.222.0.24 "GET /compute/v2.1/servers/080936a4-151d-4f4b-a750-937d342729db" status: 200 len: 1215 microversion: 2.1 time: 0.299059 May 19 13:31:25.157848 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 10/20] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:31:24 2022] GET /compute/v2.1/servers/080936a4-151d-4f4b-a750-937d342729db => generated 1215 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:31:26.007998 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-0eebcfef-e4a7-4bbf-8321-affa34a9a26e tempest-VolumesSnapshotsTestJSON-1266838011 tempest-VolumesSnapshotsTestJSON-1266838011-project] Calling method '.version_select at 0x7f7c2c3b5d30>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:31:26.045908 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-0eebcfef-e4a7-4bbf-8321-affa34a9a26e tempest-VolumesSnapshotsTestJSON-1266838011 tempest-VolumesSnapshotsTestJSON-1266838011-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/c2623dfa-aca5-4296-b383-bc0ae13af117" status: 200 len: 286 microversion: 2.1 time: 0.039864 May 19 13:31:26.049928 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 11/21] 10.222.0.24 () {58 vars in 1250 bytes} [Thu May 19 13:31:26 2022] GET /compute/v2.1/os-snapshots/c2623dfa-aca5-4296-b383-bc0ae13af117 => generated 286 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:31:26.172631 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-5f3c65d4-6388-4e58-9e34-68be5b95fa8a tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:31:26.173905 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-5f3c65d4-6388-4e58-9e34-68be5b95fa8a tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] [instance: 080936a4-151d-4f4b-a750-937d342729db] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:31:26.347798 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-5f3c65d4-6388-4e58-9e34-68be5b95fa8a tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ceb5b9477e431ba4a01adf2f3f485a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b09e85301c4e349b6714b13ae2e955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:31:26.357260 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-5f3c65d4-6388-4e58-9e34-68be5b95fa8a tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] 10.222.0.24 "GET /compute/v2.1/servers/080936a4-151d-4f4b-a750-937d342729db" status: 200 len: 1215 microversion: 2.1 time: 0.188586 May 19 13:31:26.369278 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 11/22] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:31:26 2022] GET /compute/v2.1/servers/080936a4-151d-4f4b-a750-937d342729db => generated 1215 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:31:27.061738 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-664f5f86-1a9e-472d-b661-c8126bc1521b tempest-VolumesSnapshotsTestJSON-1266838011 tempest-VolumesSnapshotsTestJSON-1266838011-project] Calling method '.version_select at 0x7f7c2c4fd670>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:31:27.123651 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-664f5f86-1a9e-472d-b661-c8126bc1521b tempest-VolumesSnapshotsTestJSON-1266838011 tempest-VolumesSnapshotsTestJSON-1266838011-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/c2623dfa-aca5-4296-b383-bc0ae13af117" status: 200 len: 287 microversion: 2.1 time: 0.067870 May 19 13:31:27.124746 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 12/23] 10.222.0.24 () {58 vars in 1250 bytes} [Thu May 19 13:31:27 2022] GET /compute/v2.1/os-snapshots/c2623dfa-aca5-4296-b383-bc0ae13af117 => generated 287 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 13:31:27.135227 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-64d4839a-7dbe-4df8-9e83-45b0fb3c21b5 tempest-VolumesSnapshotsTestJSON-1266838011 tempest-VolumesSnapshotsTestJSON-1266838011-project] Calling method '.version_select at 0x7f7c2c4fdca0>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:31:27.275993 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-64d4839a-7dbe-4df8-9e83-45b0fb3c21b5 tempest-VolumesSnapshotsTestJSON-1266838011 tempest-VolumesSnapshotsTestJSON-1266838011-project] 10.222.0.24 "DELETE /compute/v2.1/os-snapshots/c2623dfa-aca5-4296-b383-bc0ae13af117" status: 202 len: 0 microversion: 2.1 time: 0.144740 May 19 13:31:27.278223 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 13/24] 10.222.0.24 () {58 vars in 1253 bytes} [Thu May 19 13:31:27 2022] DELETE /compute/v2.1/os-snapshots/c2623dfa-aca5-4296-b383-bc0ae13af117 => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 13:31:27.285492 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-b578c118-64d4-4f9b-bf94-07011070889c tempest-VolumesSnapshotsTestJSON-1266838011 tempest-VolumesSnapshotsTestJSON-1266838011-project] Calling method '.version_select at 0x7f7c2c4fdd30>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:31:27.353543 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-b578c118-64d4-4f9b-bf94-07011070889c tempest-VolumesSnapshotsTestJSON-1266838011 tempest-VolumesSnapshotsTestJSON-1266838011-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/c2623dfa-aca5-4296-b383-bc0ae13af117" status: 200 len: 286 microversion: 2.1 time: 0.071887 May 19 13:31:27.354465 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 14/25] 10.222.0.24 () {58 vars in 1250 bytes} [Thu May 19 13:31:27 2022] GET /compute/v2.1/os-snapshots/c2623dfa-aca5-4296-b383-bc0ae13af117 => generated 286 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:31:27.380723 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-9ed5a9eb-3676-42bf-8a4f-b10637766370 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:31:27.381332 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-9ed5a9eb-3676-42bf-8a4f-b10637766370 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] [instance: 080936a4-151d-4f4b-a750-937d342729db] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:31:27.595073 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-0a6beeb4-1852-44ca-9258-b63c3935e3ad tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Action: 'create', calling method: .version_select at 0x7f7c2c3b5c10>, body: {"keypair": {"name": "tempest-keypair-1913081529", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPtcKIBq0LGxJQOQD8jA09JAVHH4BywQNg1Pji+s66VTl9St0wq/tqWTHh4TrL2vgVxBaQEfN99NQlgXB1wz3F/mwD+6Uby4NF3WvqbVmtptGZLJ/sClVvMiRaW0JpLJQw=="}} {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:31:27.678799 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.quota [None req-0a6beeb4-1852-44ca-9258-b63c3935e3ad tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Getting quotas for project 959c5c84bd724d2688f435b15b41f1c8. Resources: {'key_pairs'} {{(pid=120472) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 13:31:27.692870 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.quota [None req-0a6beeb4-1852-44ca-9258-b63c3935e3ad tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Getting quotas for user 14da69798e344e70ba64bf8187523e45 and project 959c5c84bd724d2688f435b15b41f1c8. Resources: {'key_pairs'} {{(pid=120472) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 13:31:27.747989 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-9ed5a9eb-3676-42bf-8a4f-b10637766370 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ceb5b9477e431ba4a01adf2f3f485a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b09e85301c4e349b6714b13ae2e955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:31:27.759270 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-9ed5a9eb-3676-42bf-8a4f-b10637766370 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] 10.222.0.24 "GET /compute/v2.1/servers/080936a4-151d-4f4b-a750-937d342729db" status: 200 len: 1215 microversion: 2.1 time: 0.383541 May 19 13:31:27.766983 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 15/26] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:31:27 2022] GET /compute/v2.1/servers/080936a4-151d-4f4b-a750-937d342729db => generated 1215 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:31:27.770332 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-0a6beeb4-1852-44ca-9258-b63c3935e3ad tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.084538 May 19 13:31:27.784633 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 12/27] 10.222.0.24 () {62 vars in 1199 bytes} [Thu May 19 13:31:26 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1100 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 19 13:31:27.788752 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-7c663162-a844-4b6c-9d7c-81df654016fb tempest-VolumesTestJSON-983084852 tempest-VolumesTestJSON-983084852-project] Calling method '.version_select at 0x7f7c2c4f6d30>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:31:27.965953 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-7c663162-a844-4b6c-9d7c-81df654016fb tempest-VolumesTestJSON-983084852 tempest-VolumesTestJSON-983084852-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/67462fb5-4570-49ad-8129-437d8aecea9d" status: 200 len: 351 microversion: 2.1 time: 0.197780 May 19 13:31:27.966791 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 16/28] 10.222.0.24 () {58 vars in 1244 bytes} [Thu May 19 13:31:27 2022] GET /compute/v2.1/os-volumes/67462fb5-4570-49ad-8129-437d8aecea9d => generated 351 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:31:27.979384 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-eaf3f516-0e13-4fa1-a821-1773f02dd0da tempest-VolumesTestJSON-983084852 tempest-VolumesTestJSON-983084852-project] Calling method '.version_select at 0x7f7c2b3441f0>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:31:28.215606 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-eaf3f516-0e13-4fa1-a821-1773f02dd0da tempest-VolumesTestJSON-983084852 tempest-VolumesTestJSON-983084852-project] 10.222.0.24 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.240061 May 19 13:31:28.216312 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 13/29] 10.222.0.24 () {58 vars in 1133 bytes} [Thu May 19 13:31:27 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:31:28.231142 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-fe04cfe4-ec2e-446d-947d-b263121f140e tempest-VolumesTestJSON-983084852 tempest-VolumesTestJSON-983084852-project] Calling method '.version_select at 0x7f7c2c4fd0d0>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:31:28.364729 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-0444591b-2ddb-4e41-a9ff-9c12366428ca tempest-VolumesSnapshotsTestJSON-1266838011 tempest-VolumesSnapshotsTestJSON-1266838011-project] Calling method '.version_select at 0x7f7c2b344ee0>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:31:28.444049 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-fe04cfe4-ec2e-446d-947d-b263121f140e tempest-VolumesTestJSON-983084852 tempest-VolumesTestJSON-983084852-project] 10.222.0.24 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.217671 May 19 13:31:28.445730 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 17/30] 10.222.0.24 () {58 vars in 1148 bytes} [Thu May 19 13:31:28 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:31:28.458786 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-68fdfb0a-4b84-4d27-a0f9-029321b9d60a tempest-VolumesTestJSON-983084852 tempest-VolumesTestJSON-983084852-project] Calling method '.version_select at 0x7f7c2c4fdf70>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:31:28.511906 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.wsgi [None req-0444591b-2ddb-4e41-a9ff-9c12366428ca tempest-VolumesSnapshotsTestJSON-1266838011 tempest-VolumesSnapshotsTestJSON-1266838011-project] HTTP exception thrown: Snapshot c2623dfa-aca5-4296-b383-bc0ae13af117 could not be found. May 19 13:31:28.515006 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-0444591b-2ddb-4e41-a9ff-9c12366428ca tempest-VolumesSnapshotsTestJSON-1266838011 tempest-VolumesSnapshotsTestJSON-1266838011-project] Request method failure captured: May 19 13:31:28.515006 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: request: GET /compute/v2.1/os-snapshots/c2623dfa-aca5-4296-b383-bc0ae13af117 HTTP/1.1 May 19 13:31:28.515006 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Accept: application/json May 19 13:31:28.515006 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Accept-Encoding: identity May 19 13:31:28.515006 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Connection: close May 19 13:31:28.515006 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Content-Length: 0 May 19 13:31:28.515006 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Content-Type: application/json May 19 13:31:28.515006 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Host: 10.222.0.24 May 19 13:31:28.515006 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Openstack-System-Scope: None May 19 13:31:28.515006 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: User-Agent: python-urllib3/1.26.9 May 19 13:31:28.515006 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Auth-Token: gAAAAABihkamYDld47fQ5W0oUxPkaTRhLA6Zu_ZzIRMpLZ0PW-zehB7XRyVIAj3AFxWZvD5mTHdy0g5r01N_Cbz1XUd0kQ-ATd9cfCR4atBdfhWaKz7MEnc2v4nhKlOENUssdarMhHPt1m6w219VAdW14-rQOcYDRuu3gCmdIJcI37sukTWVzP0 May 19 13:31:28.515006 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Domain-Id: None May 19 13:31:28.515006 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Domain-Name: None May 19 13:31:28.515006 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Identity-Status: Confirmed May 19 13:31:28.515006 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Is-Admin-Project: True May 19 13:31:28.515006 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Domain-Id: default May 19 13:31:28.515006 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Domain-Name: Default May 19 13:31:28.515006 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Id: 6c7967c1e3ad47cc9e2fbd3de2c673b5 May 19 13:31:28.515006 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1266838011 May 19 13:31:28.515006 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Role: reader,member May 19 13:31:28.515006 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Roles: reader,member May 19 13:31:28.516277 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/6c7967c1e3ad47cc9e2fbd3de2c673b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/6c7967c1e3ad47cc9e2fbd3de2c673b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_6c7967c1e3ad47cc9e2fbd3de2c673b5", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/6c7967c1e3ad47cc9e2fbd3de2c673b5"}]}] May 19 13:31:28.516277 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1266838011 May 19 13:31:28.516277 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant-Id: 6c7967c1e3ad47cc9e2fbd3de2c673b5 May 19 13:31:28.516277 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1266838011 May 19 13:31:28.516277 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User: tempest-VolumesSnapshotsTestJSON-1266838011-project May 19 13:31:28.516277 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Domain-Id: default May 19 13:31:28.516277 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Domain-Name: Default May 19 13:31:28.516277 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Id: 2b7e594fef204cf48bde8b68b7c6f2f8 May 19 13:31:28.516277 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1266838011-project May 19 13:31:28.516277 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: method: May 19 13:31:28.516277 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: exception: Snapshot c2623dfa-aca5-4296-b383-bc0ae13af117 could not be found. May 19 13:31:28.516277 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: action_args: {'id': 'c2623dfa-aca5-4296-b383-bc0ae13af117'} May 19 13:31:28.516277 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:31:28.517033 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:31:28.517033 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 19 13:31:28.517033 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 19 13:31:28.517033 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 19 13:31:28.517033 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 19 13:31:28.517033 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 19 13:31:28.517033 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 19 13:31:28.517033 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 13:31:28.517033 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 13:31:28.517033 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 13:31:28.517033 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 13:31:28.517033 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 13:31:28.517033 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 13:31:28.517033 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 13:31:28.517033 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 13:31:28.517033 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot c2623dfa-aca5-4296-b383-bc0ae13af117 could not be found. (HTTP 404) (Request-ID: req-4cc4bde0-06cd-4698-a061-4b8b012ed80e) May 19 13:31:28.517033 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:31:28.517033 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:31:28.517993 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:31:28.517993 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:31:28.517993 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 19 13:31:28.517993 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 19 13:31:28.517993 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 19 13:31:28.517993 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 19 13:31:28.517993 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 19 13:31:28.517993 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 19 13:31:28.517993 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 19 13:31:28.517993 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 19 13:31:28.517993 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 19 13:31:28.517993 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 19 13:31:28.517993 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 19 13:31:28.517993 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 19 13:31:28.517993 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 19 13:31:28.517993 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 19 13:31:28.517993 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 13:31:28.517993 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 13:31:28.517993 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 13:31:28.519239 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 13:31:28.519239 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 13:31:28.519239 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 13:31:28.519239 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 13:31:28.519239 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 13:31:28.519239 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot c2623dfa-aca5-4296-b383-bc0ae13af117 could not be found. May 19 13:31:28.519239 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:31:28.519239 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:31:28.519239 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:31:28.519239 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:31:28.519239 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:31:28.519239 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:31:28.519239 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:31:28.519239 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:31:28.519239 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 13:31:28.519239 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 13:31:28.519239 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:31:28.519239 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:31:28.519239 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 19 13:31:28.519239 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 13:31:28.520711 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot c2623dfa-aca5-4296-b383-bc0ae13af117 could not be found. May 19 13:31:28.520711 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:31:28.520711 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:31:28.520711 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:31:28.520711 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:31:28.520711 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:31:28.520711 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:31:28.520711 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:31:28.520711 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:31:28.520711 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot c2623dfa-aca5-4296-b383-bc0ae13af117 could not be found. May 19 13:31:28.520711 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:31:28.520711 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-0444591b-2ddb-4e41-a9ff-9c12366428ca tempest-VolumesSnapshotsTestJSON-1266838011 tempest-VolumesSnapshotsTestJSON-1266838011-project] Returning 404 to user: Snapshot c2623dfa-aca5-4296-b383-bc0ae13af117 could not be found. {{(pid=120472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:31:28.520711 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-0444591b-2ddb-4e41-a9ff-9c12366428ca tempest-VolumesSnapshotsTestJSON-1266838011 tempest-VolumesSnapshotsTestJSON-1266838011-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/c2623dfa-aca5-4296-b383-bc0ae13af117" status: 404 len: 111 microversion: 2.1 time: 0.155806 May 19 13:31:28.521574 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 14/31] 10.222.0.24 () {58 vars in 1250 bytes} [Thu May 19 13:31:28 2022] GET /compute/v2.1/os-snapshots/c2623dfa-aca5-4296-b383-bc0ae13af117 => generated 111 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 13:31:28.530023 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-88443238-19f9-4885-9acc-af7b2b34717b tempest-VolumesSnapshotsTestJSON-1266838011 tempest-VolumesSnapshotsTestJSON-1266838011-project] Calling method '.version_select at 0x7f7c2b36b5e0>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:31:28.717734 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-68fdfb0a-4b84-4d27-a0f9-029321b9d60a tempest-VolumesTestJSON-983084852 tempest-VolumesTestJSON-983084852-project] 10.222.0.24 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.263494 May 19 13:31:28.718928 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 18/32] 10.222.0.24 () {58 vars in 1133 bytes} [Thu May 19 13:31:28 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:31:28.731832 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-ca1c7663-7342-40ca-9ceb-8266a67453b0 tempest-VolumesTestJSON-983084852 tempest-VolumesTestJSON-983084852-project] Calling method '.version_select at 0x7f7c2c533af0>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:31:28.917900 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-88443238-19f9-4885-9acc-af7b2b34717b tempest-VolumesSnapshotsTestJSON-1266838011 tempest-VolumesSnapshotsTestJSON-1266838011-project] 10.222.0.24 "DELETE /compute/v2.1/os-volumes/3c1ddd62-55ba-46fc-b062-c3a625e96962" status: 202 len: 0 microversion: 2.1 time: 0.396476 May 19 13:31:28.919339 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 15/33] 10.222.0.24 () {58 vars in 1247 bytes} [Thu May 19 13:31:28 2022] DELETE /compute/v2.1/os-volumes/3c1ddd62-55ba-46fc-b062-c3a625e96962 => generated 0 bytes in 399 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 13:31:28.928368 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-512c9f57-5b80-4cbc-814b-bb593a240ec7 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:31:28.930606 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-512c9f57-5b80-4cbc-814b-bb593a240ec7 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] [instance: 080936a4-151d-4f4b-a750-937d342729db] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:31:28.987733 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-512c9f57-5b80-4cbc-814b-bb593a240ec7 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:28.988884 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-512c9f57-5b80-4cbc-814b-bb593a240ec7 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:28.989632 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-512c9f57-5b80-4cbc-814b-bb593a240ec7 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:28.994544 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-512c9f57-5b80-4cbc-814b-bb593a240ec7 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:29.320473 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-ca1c7663-7342-40ca-9ceb-8266a67453b0 tempest-VolumesTestJSON-983084852 tempest-VolumesTestJSON-983084852-project] 10.222.0.24 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.592773 May 19 13:31:29.321334 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 19/34] 10.222.0.24 () {58 vars in 1166 bytes} [Thu May 19 13:31:28 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:31:29.331711 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-3fa45766-5f58-4caf-9029-f198dfa4f2fb tempest-VolumesSnapshotsTestJSON-1266838011 tempest-VolumesSnapshotsTestJSON-1266838011-project] Calling method '.version_select at 0x7f7c2c4fd9d0>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:31:29.422803 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.wsgi [None req-3fa45766-5f58-4caf-9029-f198dfa4f2fb tempest-VolumesSnapshotsTestJSON-1266838011 tempest-VolumesSnapshotsTestJSON-1266838011-project] HTTP exception thrown: Volume 3c1ddd62-55ba-46fc-b062-c3a625e96962 could not be found. May 19 13:31:29.427179 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-3fa45766-5f58-4caf-9029-f198dfa4f2fb tempest-VolumesSnapshotsTestJSON-1266838011 tempest-VolumesSnapshotsTestJSON-1266838011-project] Request method failure captured: May 19 13:31:29.427179 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: request: GET /compute/v2.1/os-volumes/3c1ddd62-55ba-46fc-b062-c3a625e96962 HTTP/1.1 May 19 13:31:29.427179 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Accept: application/json May 19 13:31:29.427179 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Accept-Encoding: identity May 19 13:31:29.427179 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Connection: close May 19 13:31:29.427179 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Content-Length: 0 May 19 13:31:29.427179 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Content-Type: application/json May 19 13:31:29.427179 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Host: 10.222.0.24 May 19 13:31:29.427179 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Openstack-System-Scope: None May 19 13:31:29.427179 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: User-Agent: python-urllib3/1.26.9 May 19 13:31:29.427179 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Auth-Token: gAAAAABihkamYDld47fQ5W0oUxPkaTRhLA6Zu_ZzIRMpLZ0PW-zehB7XRyVIAj3AFxWZvD5mTHdy0g5r01N_Cbz1XUd0kQ-ATd9cfCR4atBdfhWaKz7MEnc2v4nhKlOENUssdarMhHPt1m6w219VAdW14-rQOcYDRuu3gCmdIJcI37sukTWVzP0 May 19 13:31:29.427179 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Domain-Id: None May 19 13:31:29.427179 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Domain-Name: None May 19 13:31:29.427179 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Identity-Status: Confirmed May 19 13:31:29.427179 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Is-Admin-Project: True May 19 13:31:29.427179 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Domain-Id: default May 19 13:31:29.427179 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Domain-Name: Default May 19 13:31:29.427179 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Id: 6c7967c1e3ad47cc9e2fbd3de2c673b5 May 19 13:31:29.427179 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1266838011 May 19 13:31:29.427179 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Role: reader,member May 19 13:31:29.427179 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Roles: reader,member May 19 13:31:29.428267 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/6c7967c1e3ad47cc9e2fbd3de2c673b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/6c7967c1e3ad47cc9e2fbd3de2c673b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_6c7967c1e3ad47cc9e2fbd3de2c673b5", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/6c7967c1e3ad47cc9e2fbd3de2c673b5"}]}] May 19 13:31:29.428267 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1266838011 May 19 13:31:29.428267 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Tenant-Id: 6c7967c1e3ad47cc9e2fbd3de2c673b5 May 19 13:31:29.428267 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1266838011 May 19 13:31:29.428267 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User: tempest-VolumesSnapshotsTestJSON-1266838011-project May 19 13:31:29.428267 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Domain-Id: default May 19 13:31:29.428267 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Domain-Name: Default May 19 13:31:29.428267 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Id: 2b7e594fef204cf48bde8b68b7c6f2f8 May 19 13:31:29.428267 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1266838011-project May 19 13:31:29.428267 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: method: May 19 13:31:29.428267 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: exception: Volume 3c1ddd62-55ba-46fc-b062-c3a625e96962 could not be found. May 19 13:31:29.428267 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: action_args: {'id': '3c1ddd62-55ba-46fc-b062-c3a625e96962'} May 19 13:31:29.428267 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:31:29.429026 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:31:29.429026 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 13:31:29.429026 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 13:31:29.429026 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 19 13:31:29.429026 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi item = cinderclient( May 19 13:31:29.429026 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 19 13:31:29.429026 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 19 13:31:29.429026 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 13:31:29.429026 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 13:31:29.429026 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 13:31:29.429026 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 13:31:29.429026 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 13:31:29.429026 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 13:31:29.429026 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 13:31:29.429026 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 13:31:29.429026 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3c1ddd62-55ba-46fc-b062-c3a625e96962 could not be found. (HTTP 404) (Request-ID: req-0a9ddde6-8858-4aac-ba3b-466bd35e26ac) May 19 13:31:29.429026 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:31:29.429026 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:31:29.429026 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:31:29.429961 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:31:29.429961 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 19 13:31:29.429961 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 19 13:31:29.429961 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 19 13:31:29.429961 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 19 13:31:29.429961 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 19 13:31:29.429961 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 19 13:31:29.429961 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 19 13:31:29.429961 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 19 13:31:29.429961 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 13:31:29.429961 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 13:31:29.429961 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 19 13:31:29.429961 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi item = cinderclient( May 19 13:31:29.429961 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 19 13:31:29.429961 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 19 13:31:29.429961 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 13:31:29.429961 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 13:31:29.429961 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 13:31:29.429961 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 13:31:29.430859 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 13:31:29.430859 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 13:31:29.430859 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 13:31:29.430859 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 13:31:29.430859 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3c1ddd62-55ba-46fc-b062-c3a625e96962 could not be found. May 19 13:31:29.430859 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:31:29.430859 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:31:29.430859 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:31:29.430859 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:31:29.430859 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:31:29.430859 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:31:29.430859 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:31:29.430859 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:31:29.430859 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 13:31:29.430859 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 13:31:29.430859 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:31:29.430859 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:31:29.430859 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 19 13:31:29.430859 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 13:31:29.431805 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3c1ddd62-55ba-46fc-b062-c3a625e96962 could not be found. May 19 13:31:29.431805 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:31:29.431805 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:31:29.431805 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:31:29.431805 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:31:29.431805 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:31:29.431805 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:31:29.431805 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:31:29.431805 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:31:29.431805 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3c1ddd62-55ba-46fc-b062-c3a625e96962 could not be found. May 19 13:31:29.431805 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:31:29.431805 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-3fa45766-5f58-4caf-9029-f198dfa4f2fb tempest-VolumesSnapshotsTestJSON-1266838011 tempest-VolumesSnapshotsTestJSON-1266838011-project] Returning 404 to user: Volume 3c1ddd62-55ba-46fc-b062-c3a625e96962 could not be found. {{(pid=120471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:31:29.431805 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-3fa45766-5f58-4caf-9029-f198dfa4f2fb tempest-VolumesSnapshotsTestJSON-1266838011 tempest-VolumesSnapshotsTestJSON-1266838011-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/3c1ddd62-55ba-46fc-b062-c3a625e96962" status: 404 len: 109 microversion: 2.1 time: 0.106174 May 19 13:31:29.437060 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 20/35] 10.222.0.24 () {58 vars in 1244 bytes} [Thu May 19 13:31:29 2022] GET /compute/v2.1/os-volumes/3c1ddd62-55ba-46fc-b062-c3a625e96962 => generated 109 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 13:31:29.462914 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-f4bbfec5-d9e5-4f8b-8620-fbc8551e928e tempest-VolumesTestJSON-983084852 tempest-VolumesTestJSON-983084852-project] Calling method '.version_select at 0x7f7c2c4713a0>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:31:29.690794 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-f4bbfec5-d9e5-4f8b-8620-fbc8551e928e tempest-VolumesTestJSON-983084852 tempest-VolumesTestJSON-983084852-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.252540 May 19 13:31:29.691644 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 21/36] 10.222.0.24 () {58 vars in 1169 bytes} [Thu May 19 13:31:29 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:31:29.703719 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-bdc69ca0-4842-4f68-8661-5adc6407a176 tempest-VolumesSnapshotsTestJSON-1266838011 tempest-VolumesSnapshotsTestJSON-1266838011-project] Calling method '.version_select at 0x7f7c2c4750d0>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:31:29.787085 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.wsgi [None req-bdc69ca0-4842-4f68-8661-5adc6407a176 tempest-VolumesSnapshotsTestJSON-1266838011 tempest-VolumesSnapshotsTestJSON-1266838011-project] HTTP exception thrown: Volume 3c1ddd62-55ba-46fc-b062-c3a625e96962 could not be found. May 19 13:31:29.790386 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-bdc69ca0-4842-4f68-8661-5adc6407a176 tempest-VolumesSnapshotsTestJSON-1266838011 tempest-VolumesSnapshotsTestJSON-1266838011-project] Request method failure captured: May 19 13:31:29.790386 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: request: DELETE /compute/v2.1/os-volumes/3c1ddd62-55ba-46fc-b062-c3a625e96962 HTTP/1.1 May 19 13:31:29.790386 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Accept: application/json May 19 13:31:29.790386 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Accept-Encoding: identity May 19 13:31:29.790386 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Connection: close May 19 13:31:29.790386 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Content-Length: 0 May 19 13:31:29.790386 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Content-Type: application/json May 19 13:31:29.790386 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Host: 10.222.0.24 May 19 13:31:29.790386 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Openstack-System-Scope: None May 19 13:31:29.790386 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: User-Agent: python-urllib3/1.26.9 May 19 13:31:29.790386 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Auth-Token: gAAAAABihkamYDld47fQ5W0oUxPkaTRhLA6Zu_ZzIRMpLZ0PW-zehB7XRyVIAj3AFxWZvD5mTHdy0g5r01N_Cbz1XUd0kQ-ATd9cfCR4atBdfhWaKz7MEnc2v4nhKlOENUssdarMhHPt1m6w219VAdW14-rQOcYDRuu3gCmdIJcI37sukTWVzP0 May 19 13:31:29.790386 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Domain-Id: None May 19 13:31:29.790386 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Domain-Name: None May 19 13:31:29.790386 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Identity-Status: Confirmed May 19 13:31:29.790386 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Is-Admin-Project: True May 19 13:31:29.790386 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Domain-Id: default May 19 13:31:29.790386 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Domain-Name: Default May 19 13:31:29.790386 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Id: 6c7967c1e3ad47cc9e2fbd3de2c673b5 May 19 13:31:29.790386 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1266838011 May 19 13:31:29.790386 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Role: reader,member May 19 13:31:29.790386 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Roles: reader,member May 19 13:31:29.791948 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/6c7967c1e3ad47cc9e2fbd3de2c673b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/6c7967c1e3ad47cc9e2fbd3de2c673b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_6c7967c1e3ad47cc9e2fbd3de2c673b5", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/6c7967c1e3ad47cc9e2fbd3de2c673b5"}]}] May 19 13:31:29.791948 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1266838011 May 19 13:31:29.791948 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Tenant-Id: 6c7967c1e3ad47cc9e2fbd3de2c673b5 May 19 13:31:29.791948 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1266838011 May 19 13:31:29.791948 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User: tempest-VolumesSnapshotsTestJSON-1266838011-project May 19 13:31:29.791948 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Domain-Id: default May 19 13:31:29.791948 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Domain-Name: Default May 19 13:31:29.791948 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Id: 2b7e594fef204cf48bde8b68b7c6f2f8 May 19 13:31:29.791948 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1266838011-project May 19 13:31:29.791948 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: method: May 19 13:31:29.791948 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: exception: Volume 3c1ddd62-55ba-46fc-b062-c3a625e96962 could not be found. May 19 13:31:29.791948 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: action_args: {'id': '3c1ddd62-55ba-46fc-b062-c3a625e96962'} May 19 13:31:29.791948 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:31:29.792961 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:31:29.792961 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 13:31:29.792961 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 13:31:29.792961 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 19 13:31:29.792961 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 19 13:31:29.792961 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 19 13:31:29.792961 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 19 13:31:29.792961 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 19 13:31:29.792961 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 19 13:31:29.792961 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 19 13:31:29.792961 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 19 13:31:29.792961 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 13:31:29.792961 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 13:31:29.792961 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 13:31:29.792961 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 13:31:29.792961 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3c1ddd62-55ba-46fc-b062-c3a625e96962 could not be found. (HTTP 404) (Request-ID: req-a74bf49a-eba1-4db6-9718-ca3f38e7d056) May 19 13:31:29.792961 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:31:29.792961 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:31:29.792961 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:31:29.794439 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:31:29.794439 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 19 13:31:29.794439 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 19 13:31:29.794439 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 19 13:31:29.794439 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 19 13:31:29.794439 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 19 13:31:29.794439 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 19 13:31:29.794439 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 19 13:31:29.794439 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 19 13:31:29.794439 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 13:31:29.794439 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 13:31:29.794439 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 19 13:31:29.794439 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 19 13:31:29.794439 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 19 13:31:29.794439 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 19 13:31:29.794439 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 19 13:31:29.794439 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 19 13:31:29.794439 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 19 13:31:29.794439 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 19 13:31:29.795811 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 13:31:29.795811 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 13:31:29.795811 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 13:31:29.795811 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 13:31:29.795811 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3c1ddd62-55ba-46fc-b062-c3a625e96962 could not be found. May 19 13:31:29.795811 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:31:29.795811 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:31:29.795811 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:31:29.795811 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:31:29.795811 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:31:29.795811 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:31:29.795811 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:31:29.795811 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:31:29.795811 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 13:31:29.795811 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 13:31:29.795811 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:31:29.795811 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:31:29.795811 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 19 13:31:29.795811 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 13:31:29.797013 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3c1ddd62-55ba-46fc-b062-c3a625e96962 could not be found. May 19 13:31:29.797013 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:31:29.797013 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:31:29.797013 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:31:29.797013 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:31:29.797013 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:31:29.797013 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:31:29.797013 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:31:29.797013 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:31:29.797013 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3c1ddd62-55ba-46fc-b062-c3a625e96962 could not be found. May 19 13:31:29.797013 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:31:29.797013 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-bdc69ca0-4842-4f68-8661-5adc6407a176 tempest-VolumesSnapshotsTestJSON-1266838011 tempest-VolumesSnapshotsTestJSON-1266838011-project] Returning 404 to user: Volume 3c1ddd62-55ba-46fc-b062-c3a625e96962 could not be found. {{(pid=120471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:31:29.797013 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-bdc69ca0-4842-4f68-8661-5adc6407a176 tempest-VolumesSnapshotsTestJSON-1266838011 tempest-VolumesSnapshotsTestJSON-1266838011-project] 10.222.0.24 "DELETE /compute/v2.1/os-volumes/3c1ddd62-55ba-46fc-b062-c3a625e96962" status: 404 len: 109 microversion: 2.1 time: 0.102084 May 19 13:31:29.800856 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 22/37] 10.222.0.24 () {58 vars in 1247 bytes} [Thu May 19 13:31:29 2022] DELETE /compute/v2.1/os-volumes/3c1ddd62-55ba-46fc-b062-c3a625e96962 => generated 109 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 13:31:29.809860 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-089b6792-456b-4df2-bb98-0c6debd5559e tempest-VolumesTestJSON-983084852 tempest-VolumesTestJSON-983084852-project] Calling method '.version_select at 0x7f7c2c471790>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:31:29.880345 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-512c9f57-5b80-4cbc-814b-bb593a240ec7 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ceb5b9477e431ba4a01adf2f3f485a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b09e85301c4e349b6714b13ae2e955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:31:29.915986 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-512c9f57-5b80-4cbc-814b-bb593a240ec7 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] 10.222.0.24 "GET /compute/v2.1/servers/080936a4-151d-4f4b-a750-937d342729db" status: 200 len: 1275 microversion: 2.1 time: 0.992850 May 19 13:31:29.920846 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 16/38] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:31:28 2022] GET /compute/v2.1/servers/080936a4-151d-4f4b-a750-937d342729db => generated 1275 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:31:29.928249 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-e8e23014-8018-4107-9154-eadd41e6ad7b tempest-VolumesSnapshotsTestJSON-1266838011 tempest-VolumesSnapshotsTestJSON-1266838011-project] Calling method '.version_select at 0x7f7c2aa8e820>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:31:29.995562 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-089b6792-456b-4df2-bb98-0c6debd5559e tempest-VolumesTestJSON-983084852 tempest-VolumesTestJSON-983084852-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.196620 May 19 13:31:29.996708 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 23/39] 10.222.0.24 () {58 vars in 1154 bytes} [Thu May 19 13:31:29 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:31:30.009183 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-c4fb840a-9411-47fd-989c-4eac033ea5aa tempest-VolumesTestJSON-983084852 tempest-VolumesTestJSON-983084852-project] Calling method '.version_select at 0x7f7c2c475670>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:31:30.034964 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.wsgi [None req-e8e23014-8018-4107-9154-eadd41e6ad7b tempest-VolumesSnapshotsTestJSON-1266838011 tempest-VolumesSnapshotsTestJSON-1266838011-project] HTTP exception thrown: Volume 3c1ddd62-55ba-46fc-b062-c3a625e96962 could not be found. May 19 13:31:30.037707 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-e8e23014-8018-4107-9154-eadd41e6ad7b tempest-VolumesSnapshotsTestJSON-1266838011 tempest-VolumesSnapshotsTestJSON-1266838011-project] Request method failure captured: May 19 13:31:30.037707 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: request: GET /compute/v2.1/os-volumes/3c1ddd62-55ba-46fc-b062-c3a625e96962 HTTP/1.1 May 19 13:31:30.037707 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Accept: application/json May 19 13:31:30.037707 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Accept-Encoding: identity May 19 13:31:30.037707 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Connection: close May 19 13:31:30.037707 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Content-Length: 0 May 19 13:31:30.037707 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Content-Type: application/json May 19 13:31:30.037707 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Host: 10.222.0.24 May 19 13:31:30.037707 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Openstack-System-Scope: None May 19 13:31:30.037707 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: User-Agent: python-urllib3/1.26.9 May 19 13:31:30.037707 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Auth-Token: gAAAAABihkamYDld47fQ5W0oUxPkaTRhLA6Zu_ZzIRMpLZ0PW-zehB7XRyVIAj3AFxWZvD5mTHdy0g5r01N_Cbz1XUd0kQ-ATd9cfCR4atBdfhWaKz7MEnc2v4nhKlOENUssdarMhHPt1m6w219VAdW14-rQOcYDRuu3gCmdIJcI37sukTWVzP0 May 19 13:31:30.037707 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Domain-Id: None May 19 13:31:30.037707 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Domain-Name: None May 19 13:31:30.037707 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Identity-Status: Confirmed May 19 13:31:30.037707 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Is-Admin-Project: True May 19 13:31:30.037707 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Domain-Id: default May 19 13:31:30.037707 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Domain-Name: Default May 19 13:31:30.037707 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Id: 6c7967c1e3ad47cc9e2fbd3de2c673b5 May 19 13:31:30.037707 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1266838011 May 19 13:31:30.037707 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Role: reader,member May 19 13:31:30.037707 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Roles: reader,member May 19 13:31:30.038847 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/6c7967c1e3ad47cc9e2fbd3de2c673b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/6c7967c1e3ad47cc9e2fbd3de2c673b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_6c7967c1e3ad47cc9e2fbd3de2c673b5", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/6c7967c1e3ad47cc9e2fbd3de2c673b5"}]}] May 19 13:31:30.038847 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1266838011 May 19 13:31:30.038847 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant-Id: 6c7967c1e3ad47cc9e2fbd3de2c673b5 May 19 13:31:30.038847 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1266838011 May 19 13:31:30.038847 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User: tempest-VolumesSnapshotsTestJSON-1266838011-project May 19 13:31:30.038847 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Domain-Id: default May 19 13:31:30.038847 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Domain-Name: Default May 19 13:31:30.038847 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Id: 2b7e594fef204cf48bde8b68b7c6f2f8 May 19 13:31:30.038847 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1266838011-project May 19 13:31:30.038847 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: method: May 19 13:31:30.038847 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: exception: Volume 3c1ddd62-55ba-46fc-b062-c3a625e96962 could not be found. May 19 13:31:30.038847 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: action_args: {'id': '3c1ddd62-55ba-46fc-b062-c3a625e96962'} May 19 13:31:30.038847 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:31:30.039587 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:31:30.039587 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 13:31:30.039587 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 13:31:30.039587 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 19 13:31:30.039587 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi item = cinderclient( May 19 13:31:30.039587 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 19 13:31:30.039587 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 19 13:31:30.039587 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 13:31:30.039587 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 13:31:30.039587 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 13:31:30.039587 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 13:31:30.039587 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 13:31:30.039587 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 13:31:30.039587 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 13:31:30.039587 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 13:31:30.039587 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3c1ddd62-55ba-46fc-b062-c3a625e96962 could not be found. (HTTP 404) (Request-ID: req-c0f4f111-c33b-4c02-a6f8-8f68ab96d1c0) May 19 13:31:30.039587 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:31:30.039587 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:31:30.039587 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:31:30.040467 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:31:30.040467 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 19 13:31:30.040467 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 19 13:31:30.040467 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 19 13:31:30.040467 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 19 13:31:30.040467 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 19 13:31:30.040467 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 19 13:31:30.040467 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 19 13:31:30.040467 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 19 13:31:30.040467 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 13:31:30.040467 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 13:31:30.040467 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 19 13:31:30.040467 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi item = cinderclient( May 19 13:31:30.040467 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 19 13:31:30.040467 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 19 13:31:30.040467 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 13:31:30.040467 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 13:31:30.040467 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 13:31:30.040467 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 13:31:30.041701 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 13:31:30.041701 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 13:31:30.041701 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 13:31:30.041701 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 13:31:30.041701 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3c1ddd62-55ba-46fc-b062-c3a625e96962 could not be found. May 19 13:31:30.041701 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:31:30.041701 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:31:30.041701 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:31:30.041701 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:31:30.041701 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:31:30.041701 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:31:30.041701 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:31:30.041701 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:31:30.041701 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 13:31:30.041701 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 13:31:30.041701 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:31:30.041701 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:31:30.041701 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 19 13:31:30.041701 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 13:31:30.042593 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3c1ddd62-55ba-46fc-b062-c3a625e96962 could not be found. May 19 13:31:30.042593 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:31:30.042593 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:31:30.042593 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:31:30.042593 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:31:30.042593 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:31:30.042593 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:31:30.042593 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:31:30.042593 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:31:30.042593 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3c1ddd62-55ba-46fc-b062-c3a625e96962 could not be found. May 19 13:31:30.042593 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:31:30.042593 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-e8e23014-8018-4107-9154-eadd41e6ad7b tempest-VolumesSnapshotsTestJSON-1266838011 tempest-VolumesSnapshotsTestJSON-1266838011-project] Returning 404 to user: Volume 3c1ddd62-55ba-46fc-b062-c3a625e96962 could not be found. {{(pid=120472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:31:30.042593 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-e8e23014-8018-4107-9154-eadd41e6ad7b tempest-VolumesSnapshotsTestJSON-1266838011 tempest-VolumesSnapshotsTestJSON-1266838011-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/3c1ddd62-55ba-46fc-b062-c3a625e96962" status: 404 len: 109 microversion: 2.1 time: 0.117169 May 19 13:31:30.042593 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 17/40] 10.222.0.24 () {58 vars in 1244 bytes} [Thu May 19 13:31:29 2022] GET /compute/v2.1/os-volumes/3c1ddd62-55ba-46fc-b062-c3a625e96962 => generated 109 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 13:31:30.216104 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-c4fb840a-9411-47fd-989c-4eac033ea5aa tempest-VolumesTestJSON-983084852 tempest-VolumesTestJSON-983084852-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.211207 May 19 13:31:30.217032 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 24/41] 10.222.0.24 () {58 vars in 1187 bytes} [Thu May 19 13:31:30 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 13:31:30.229628 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-4f470189-8d10-40ad-85f3-380c9d16c34d tempest-VolumesTestJSON-983084852 tempest-VolumesTestJSON-983084852-project] Calling method '.version_select at 0x7f7c2aa7d1f0>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:31:30.409482 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-4f470189-8d10-40ad-85f3-380c9d16c34d tempest-VolumesTestJSON-983084852 tempest-VolumesTestJSON-983084852-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.183445 May 19 13:31:30.410572 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 18/42] 10.222.0.24 () {58 vars in 1154 bytes} [Thu May 19 13:31:30 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:31:30.935622 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-da4c6df6-0e0c-41ed-9e21-0d785845658c tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:31:30.936776 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-da4c6df6-0e0c-41ed-9e21-0d785845658c tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] [instance: 080936a4-151d-4f4b-a750-937d342729db] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:31:30.949532 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-da4c6df6-0e0c-41ed-9e21-0d785845658c tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:30.950220 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-da4c6df6-0e0c-41ed-9e21-0d785845658c tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:30.951462 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-da4c6df6-0e0c-41ed-9e21-0d785845658c tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:30.952882 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-da4c6df6-0e0c-41ed-9e21-0d785845658c tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:31.939890 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-da4c6df6-0e0c-41ed-9e21-0d785845658c tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ceb5b9477e431ba4a01adf2f3f485a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b09e85301c4e349b6714b13ae2e955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:31:32.004453 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-da4c6df6-0e0c-41ed-9e21-0d785845658c tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] 10.222.0.24 "GET /compute/v2.1/servers/080936a4-151d-4f4b-a750-937d342729db" status: 200 len: 1273 microversion: 2.1 time: 1.068401 May 19 13:31:32.026007 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 25/43] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:31:30 2022] GET /compute/v2.1/servers/080936a4-151d-4f4b-a750-937d342729db => generated 1273 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:31:32.491336 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-0b2968b4-de6e-47b8-8448-ffc7fa61d30f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1640808259", "imageRef": "9beb860d-9c3f-4244-80aa-71a9c337a429", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "680a83a0-30ec-41c9-9148-fa9290c3fc14"}], "security_groups": [{"name": "tempest-securitygroup--767779278"}], "key_name": "tempest-keypair-1913081529", "user_data": "}} {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:31:32.932089 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.network.neutron [None req-0b2968b4-de6e-47b8-8448-ffc7fa61d30f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] validate_networks() for [('680a83a0-30ec-41c9-9148-fa9290c3fc14', None, None, None, None, None)] {{(pid=120472) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 13:31:33.046763 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-058cfd9c-4366-4ab9-af07-808e9ff26dae tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:31:33.048188 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-058cfd9c-4366-4ab9-af07-808e9ff26dae tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] [instance: 080936a4-151d-4f4b-a750-937d342729db] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:31:33.062520 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-058cfd9c-4366-4ab9-af07-808e9ff26dae tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:33.077451 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-058cfd9c-4366-4ab9-af07-808e9ff26dae tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:33.080480 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-058cfd9c-4366-4ab9-af07-808e9ff26dae tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:33.083475 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-058cfd9c-4366-4ab9-af07-808e9ff26dae tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:34.260406 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-058cfd9c-4366-4ab9-af07-808e9ff26dae tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ceb5b9477e431ba4a01adf2f3f485a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b09e85301c4e349b6714b13ae2e955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:31:34.270269 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-058cfd9c-4366-4ab9-af07-808e9ff26dae tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] 10.222.0.24 "GET /compute/v2.1/servers/080936a4-151d-4f4b-a750-937d342729db" status: 200 len: 1273 microversion: 2.1 time: 1.241960 May 19 13:31:34.286903 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 26/44] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:31:33 2022] GET /compute/v2.1/servers/080936a4-151d-4f4b-a750-937d342729db => generated 1273 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:31:34.306216 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.virt.hardware [None req-0b2968b4-de6e-47b8-8448-ffc7fa61d30f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Flavor limits 0:0:0 {{(pid=120472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 13:31:34.307271 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.virt.hardware [None req-0b2968b4-de6e-47b8-8448-ffc7fa61d30f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Image limits 0:0:0 {{(pid=120472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 13:31:34.307911 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.virt.hardware [None req-0b2968b4-de6e-47b8-8448-ffc7fa61d30f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Flavor pref 0:0:0 {{(pid=120472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 13:31:34.308464 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.virt.hardware [None req-0b2968b4-de6e-47b8-8448-ffc7fa61d30f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Image pref 0:0:0 {{(pid=120472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 13:31:34.309027 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.virt.hardware [None req-0b2968b4-de6e-47b8-8448-ffc7fa61d30f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 13:31:34.326401 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-0b2968b4-de6e-47b8-8448-ffc7fa61d30f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:34.334287 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-0b2968b4-de6e-47b8-8448-ffc7fa61d30f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:34.335501 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-0b2968b4-de6e-47b8-8448-ffc7fa61d30f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:34.335992 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-0b2968b4-de6e-47b8-8448-ffc7fa61d30f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:34.382341 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.quota [None req-0b2968b4-de6e-47b8-8448-ffc7fa61d30f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Getting quotas for project 959c5c84bd724d2688f435b15b41f1c8. Resources: {'instances', 'cores', 'ram'} {{(pid=120472) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 13:31:34.388543 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.quota [None req-0b2968b4-de6e-47b8-8448-ffc7fa61d30f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Getting quotas for user 14da69798e344e70ba64bf8187523e45 and project 959c5c84bd724d2688f435b15b41f1c8. Resources: {'instances', 'cores', 'ram'} {{(pid=120472) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 13:31:34.412233 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-0b2968b4-de6e-47b8-8448-ffc7fa61d30f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Going to run 1 instances... {{(pid=120472) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 13:31:34.415661 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-0b2968b4-de6e-47b8-8448-ffc7fa61d30f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9beb860d-9c3f-4244-80aa-71a9c337a429',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120472) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 13:31:34.536097 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-0b2968b4-de6e-47b8-8448-ffc7fa61d30f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.053952 May 19 13:31:34.544165 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 19/45] 10.222.0.24 () {62 vars in 1187 bytes} [Thu May 19 13:31:32 2022] POST /compute/v2.1/servers => generated 401 bytes in 2066 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 19 13:31:34.555995 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-ef9df4f8-1a2a-4d9c-b361-21757a6cae75 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:31:34.557343 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-ef9df4f8-1a2a-4d9c-b361-21757a6cae75 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:31:35.132966 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-ef9df4f8-1a2a-4d9c-b361-21757a6cae75 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:31:35.149390 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-ef9df4f8-1a2a-4d9c-b361-21757a6cae75 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:31:35.158139 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-ef9df4f8-1a2a-4d9c-b361-21757a6cae75 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:31:35.164752 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-ef9df4f8-1a2a-4d9c-b361-21757a6cae75 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1282 microversion: 2.20 time: 0.615165 May 19 13:31:35.177959 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 27/46] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:31:34 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1282 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:31:35.297591 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-117f5192-ca3e-4072-867f-755866fb9888 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:31:35.298287 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-117f5192-ca3e-4072-867f-755866fb9888 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] [instance: 080936a4-151d-4f4b-a750-937d342729db] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:31:35.327355 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-117f5192-ca3e-4072-867f-755866fb9888 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:35.329251 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-117f5192-ca3e-4072-867f-755866fb9888 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:35.331827 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-117f5192-ca3e-4072-867f-755866fb9888 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:35.332268 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-117f5192-ca3e-4072-867f-755866fb9888 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:35.883403 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-3ca4a009-7fdc-482b-8520-45965f4e8006 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-745888377", "imageRef": "9beb860d-9c3f-4244-80aa-71a9c337a429", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:31:36.010462 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-117f5192-ca3e-4072-867f-755866fb9888 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ceb5b9477e431ba4a01adf2f3f485a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b09e85301c4e349b6714b13ae2e955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:31:36.022178 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-117f5192-ca3e-4072-867f-755866fb9888 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] 10.222.0.24 "GET /compute/v2.1/servers/080936a4-151d-4f4b-a750-937d342729db" status: 200 len: 1315 microversion: 2.1 time: 0.728538 May 19 13:31:36.023617 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 28/47] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:31:35 2022] GET /compute/v2.1/servers/080936a4-151d-4f4b-a750-937d342729db => generated 1315 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:31:36.030841 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.network.neutron [None req-3ca4a009-7fdc-482b-8520-45965f4e8006 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] validate_networks() for [('a42ef65b-f8fc-4078-973d-4d38cc62962d', None, None, None, None, None)] {{(pid=120472) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 13:31:36.185434 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-df2be289-bd5a-4ec1-bcb1-de5825fcd059 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:31:36.190118 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-df2be289-bd5a-4ec1-bcb1-de5825fcd059 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:31:36.333166 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-df2be289-bd5a-4ec1-bcb1-de5825fcd059 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:31:36.343953 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-df2be289-bd5a-4ec1-bcb1-de5825fcd059 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:31:36.346910 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-df2be289-bd5a-4ec1-bcb1-de5825fcd059 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:31:36.350797 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-df2be289-bd5a-4ec1-bcb1-de5825fcd059 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1282 microversion: 2.20 time: 0.169124 May 19 13:31:36.355192 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 29/48] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:31:36 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1282 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 13:31:37.042358 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-ec3d2480-fe94-4d93-9f10-352f91ee2f32 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:31:37.043010 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-ec3d2480-fe94-4d93-9f10-352f91ee2f32 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] [instance: 080936a4-151d-4f4b-a750-937d342729db] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:31:37.057835 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-ec3d2480-fe94-4d93-9f10-352f91ee2f32 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:37.058035 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-ec3d2480-fe94-4d93-9f10-352f91ee2f32 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:37.058795 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-ec3d2480-fe94-4d93-9f10-352f91ee2f32 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:37.059228 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-ec3d2480-fe94-4d93-9f10-352f91ee2f32 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:37.094584 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.virt.hardware [None req-3ca4a009-7fdc-482b-8520-45965f4e8006 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Flavor limits 0:0:0 {{(pid=120472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 13:31:37.095179 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.virt.hardware [None req-3ca4a009-7fdc-482b-8520-45965f4e8006 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Image limits 0:0:0 {{(pid=120472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 13:31:37.095557 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.virt.hardware [None req-3ca4a009-7fdc-482b-8520-45965f4e8006 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Flavor pref 0:0:0 {{(pid=120472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 13:31:37.096690 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.virt.hardware [None req-3ca4a009-7fdc-482b-8520-45965f4e8006 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Image pref 0:0:0 {{(pid=120472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 13:31:37.097561 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.virt.hardware [None req-3ca4a009-7fdc-482b-8520-45965f4e8006 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 13:31:37.129385 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-3ca4a009-7fdc-482b-8520-45965f4e8006 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:37.130125 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-3ca4a009-7fdc-482b-8520-45965f4e8006 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:37.131434 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-3ca4a009-7fdc-482b-8520-45965f4e8006 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:37.134048 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-3ca4a009-7fdc-482b-8520-45965f4e8006 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:37.172593 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.quota [None req-3ca4a009-7fdc-482b-8520-45965f4e8006 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Getting quotas for project 63972a518bb048d19dd070eb9ac85445. Resources: {'instances', 'cores', 'ram'} {{(pid=120472) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 13:31:37.181283 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.quota [None req-3ca4a009-7fdc-482b-8520-45965f4e8006 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Getting quotas for user 2d3b91bfd0304cc793e3ad52c9b9e865 and project 63972a518bb048d19dd070eb9ac85445. Resources: {'instances', 'cores', 'ram'} {{(pid=120472) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 13:31:37.199433 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-3ca4a009-7fdc-482b-8520-45965f4e8006 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Going to run 1 instances... {{(pid=120472) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 13:31:37.203016 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-3ca4a009-7fdc-482b-8520-45965f4e8006 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: c4c1abc9-8651-4788-9650-27704ae7e306] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9beb860d-9c3f-4244-80aa-71a9c337a429',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120472) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 13:31:37.293179 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-3ca4a009-7fdc-482b-8520-45965f4e8006 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.129163 May 19 13:31:37.299344 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 20/49] 10.222.0.24 () {60 vars in 1146 bytes} [Thu May 19 13:31:35 2022] POST /compute/v2.1/servers => generated 383 bytes in 2136 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 13:31:37.310403 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-142e80eb-a1fb-4957-ba7c-3bfc46c08d89 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:31:37.312599 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-142e80eb-a1fb-4957-ba7c-3bfc46c08d89 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: c4c1abc9-8651-4788-9650-27704ae7e306] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:31:37.423033 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-ec3d2480-fe94-4d93-9f10-352f91ee2f32 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ceb5b9477e431ba4a01adf2f3f485a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b09e85301c4e349b6714b13ae2e955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:31:37.440801 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-ec3d2480-fe94-4d93-9f10-352f91ee2f32 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] 10.222.0.24 "GET /compute/v2.1/servers/080936a4-151d-4f4b-a750-937d342729db" status: 200 len: 1315 microversion: 2.1 time: 0.404585 May 19 13:31:37.444679 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 30/50] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:31:37 2022] GET /compute/v2.1/servers/080936a4-151d-4f4b-a750-937d342729db => generated 1315 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:31:37.455055 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-c130e55d-03fc-445d-bba9-947f3f4e54ba tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:31:37.455975 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-c130e55d-03fc-445d-bba9-947f3f4e54ba tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:31:37.478918 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-c130e55d-03fc-445d-bba9-947f3f4e54ba tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:37.480730 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-c130e55d-03fc-445d-bba9-947f3f4e54ba tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:37.481642 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-c130e55d-03fc-445d-bba9-947f3f4e54ba tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:37.484679 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-c130e55d-03fc-445d-bba9-947f3f4e54ba tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:37.519415 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-142e80eb-a1fb-4957-ba7c-3bfc46c08d89 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:31:37.545993 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-142e80eb-a1fb-4957-ba7c-3bfc46c08d89 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306" status: 200 len: 1221 microversion: 2.1 time: 0.241383 May 19 13:31:37.566521 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 21/51] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:31:37 2022] GET /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306 => generated 1221 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:31:37.727118 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-c130e55d-03fc-445d-bba9-947f3f4e54ba tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:31:37.745954 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-c130e55d-03fc-445d-bba9-947f3f4e54ba tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:31:37.754624 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-c130e55d-03fc-445d-bba9-947f3f4e54ba tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:31:37.760276 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-c130e55d-03fc-445d-bba9-947f3f4e54ba tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1286 microversion: 2.20 time: 0.311762 May 19 13:31:37.763076 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 31/52] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:31:37 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1286 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:31:37.824187 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-d1e71311-c4e7-4ce1-b1fa-6040a9fdeae4 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1247881404", "imageRef": "9beb860d-9c3f-4244-80aa-71a9c337a429", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:31:37.976644 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.network.neutron [None req-d1e71311-c4e7-4ce1-b1fa-6040a9fdeae4 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] validate_networks() for [('a42ef65b-f8fc-4078-973d-4d38cc62962d', None, None, None, None, None)] {{(pid=120472) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 13:31:38.463180 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-9e20a4c8-9c99-4430-9b5e-6ce68c386854 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:31:38.464476 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-9e20a4c8-9c99-4430-9b5e-6ce68c386854 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] [instance: 080936a4-151d-4f4b-a750-937d342729db] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:31:38.496209 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-9e20a4c8-9c99-4430-9b5e-6ce68c386854 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:38.498694 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-9e20a4c8-9c99-4430-9b5e-6ce68c386854 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:38.505172 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-9e20a4c8-9c99-4430-9b5e-6ce68c386854 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:38.507986 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-9e20a4c8-9c99-4430-9b5e-6ce68c386854 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:38.949137 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-9e20a4c8-9c99-4430-9b5e-6ce68c386854 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ceb5b9477e431ba4a01adf2f3f485a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b09e85301c4e349b6714b13ae2e955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:31:38.970196 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-9e20a4c8-9c99-4430-9b5e-6ce68c386854 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] 10.222.0.24 "GET /compute/v2.1/servers/080936a4-151d-4f4b-a750-937d342729db" status: 200 len: 1315 microversion: 2.1 time: 0.507229 May 19 13:31:38.973143 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 32/53] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:31:38 2022] GET /compute/v2.1/servers/080936a4-151d-4f4b-a750-937d342729db => generated 1315 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:31:38.985783 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-d5aa62f9-558a-48df-842a-1f5bdd5f2f15 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:31:38.998680 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-d5aa62f9-558a-48df-842a-1f5bdd5f2f15 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:31:39.026366 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-d5aa62f9-558a-48df-842a-1f5bdd5f2f15 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:39.026814 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-d5aa62f9-558a-48df-842a-1f5bdd5f2f15 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:39.027579 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-d5aa62f9-558a-48df-842a-1f5bdd5f2f15 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:39.032284 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-d5aa62f9-558a-48df-842a-1f5bdd5f2f15 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:39.375673 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-d5aa62f9-558a-48df-842a-1f5bdd5f2f15 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:31:39.396032 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-d5aa62f9-558a-48df-842a-1f5bdd5f2f15 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:31:39.410108 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-d5aa62f9-558a-48df-842a-1f5bdd5f2f15 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:31:39.413182 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-d5aa62f9-558a-48df-842a-1f5bdd5f2f15 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1334 microversion: 2.20 time: 0.438053 May 19 13:31:39.418438 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 33/54] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:31:38 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1334 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:31:39.581143 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.virt.hardware [None req-d1e71311-c4e7-4ce1-b1fa-6040a9fdeae4 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Flavor limits 0:0:0 {{(pid=120472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 13:31:39.582183 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.virt.hardware [None req-d1e71311-c4e7-4ce1-b1fa-6040a9fdeae4 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Image limits 0:0:0 {{(pid=120472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 13:31:39.582800 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.virt.hardware [None req-d1e71311-c4e7-4ce1-b1fa-6040a9fdeae4 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Flavor pref 0:0:0 {{(pid=120472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 13:31:39.583369 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.virt.hardware [None req-d1e71311-c4e7-4ce1-b1fa-6040a9fdeae4 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Image pref 0:0:0 {{(pid=120472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 13:31:39.583933 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.virt.hardware [None req-d1e71311-c4e7-4ce1-b1fa-6040a9fdeae4 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 13:31:39.598781 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-d1e71311-c4e7-4ce1-b1fa-6040a9fdeae4 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:39.602084 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-d1e71311-c4e7-4ce1-b1fa-6040a9fdeae4 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:39.603243 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-d1e71311-c4e7-4ce1-b1fa-6040a9fdeae4 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:39.606211 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-d1e71311-c4e7-4ce1-b1fa-6040a9fdeae4 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:39.660395 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.quota [None req-d1e71311-c4e7-4ce1-b1fa-6040a9fdeae4 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Getting quotas for project 63972a518bb048d19dd070eb9ac85445. Resources: {'instances', 'cores', 'ram'} {{(pid=120472) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 13:31:39.676826 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.quota [None req-d1e71311-c4e7-4ce1-b1fa-6040a9fdeae4 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Getting quotas for user 2d3b91bfd0304cc793e3ad52c9b9e865 and project 63972a518bb048d19dd070eb9ac85445. Resources: {'instances', 'cores', 'ram'} {{(pid=120472) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 13:31:39.740627 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-d1e71311-c4e7-4ce1-b1fa-6040a9fdeae4 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Going to run 1 instances... {{(pid=120472) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 13:31:39.754961 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-d1e71311-c4e7-4ce1-b1fa-6040a9fdeae4 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: bb839e22-971b-4313-be06-20e09838215a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9beb860d-9c3f-4244-80aa-71a9c337a429',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120472) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 13:31:39.929800 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-d1e71311-c4e7-4ce1-b1fa-6040a9fdeae4 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.112859 May 19 13:31:39.930453 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 22/55] 10.222.0.24 () {60 vars in 1146 bytes} [Thu May 19 13:31:37 2022] POST /compute/v2.1/servers => generated 383 bytes in 2114 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 13:31:39.978528 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-a69126db-b503-4b62-8546-070a00cbbaf2 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:31:39.980425 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-a69126db-b503-4b62-8546-070a00cbbaf2 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: bb839e22-971b-4313-be06-20e09838215a] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:31:40.391247 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-a69126db-b503-4b62-8546-070a00cbbaf2 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:31:40.419741 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-a69126db-b503-4b62-8546-070a00cbbaf2 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a" status: 200 len: 1222 microversion: 2.1 time: 0.475781 May 19 13:31:40.425109 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 23/56] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:31:39 2022] GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a => generated 1222 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:31:40.470891 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-42c2c779-075c-404b-9a4c-de16b0270c8e tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:31:40.471578 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-42c2c779-075c-404b-9a4c-de16b0270c8e tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] [instance: 080936a4-151d-4f4b-a750-937d342729db] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:31:40.523447 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-42c2c779-075c-404b-9a4c-de16b0270c8e tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:40.530002 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-42c2c779-075c-404b-9a4c-de16b0270c8e tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:40.531062 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-42c2c779-075c-404b-9a4c-de16b0270c8e tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:40.549586 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-42c2c779-075c-404b-9a4c-de16b0270c8e tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:40.774652 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-9d54f0db-85c5-42ab-94e3-864988d44418 tempest-VolumesGetTestJSON-344457794 tempest-VolumesGetTestJSON-344457794-project] Action: 'create', calling method: .version_select at 0x7f7c2c3e1790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1038380442", "metadata": {"Type": "work"}}} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:31:41.620836 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-9d54f0db-85c5-42ab-94e3-864988d44418 tempest-VolumesGetTestJSON-344457794 tempest-VolumesGetTestJSON-344457794-project] 10.222.0.24 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.005202 May 19 13:31:41.621616 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 34/57] 10.222.0.24 () {60 vars in 1155 bytes} [Thu May 19 13:31:39 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 2007 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) May 19 13:31:41.628730 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-76414e55-b55e-4bd4-8211-a2fd382c54b0 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:31:41.629657 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-76414e55-b55e-4bd4-8211-a2fd382c54b0 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:31:41.639442 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-76414e55-b55e-4bd4-8211-a2fd382c54b0 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:41.640371 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-76414e55-b55e-4bd4-8211-a2fd382c54b0 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:41.642039 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-76414e55-b55e-4bd4-8211-a2fd382c54b0 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:41.642701 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-76414e55-b55e-4bd4-8211-a2fd382c54b0 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:41.696706 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-42c2c779-075c-404b-9a4c-de16b0270c8e tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ceb5b9477e431ba4a01adf2f3f485a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b09e85301c4e349b6714b13ae2e955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:31:41.707804 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-42c2c779-075c-404b-9a4c-de16b0270c8e tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] 10.222.0.24 "GET /compute/v2.1/servers/080936a4-151d-4f4b-a750-937d342729db" status: 200 len: 1315 microversion: 2.1 time: 1.271897 May 19 13:31:41.708921 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 24/58] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:31:40 2022] GET /compute/v2.1/servers/080936a4-151d-4f4b-a750-937d342729db => generated 1315 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:31:41.715123 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-0b443313-e3d7-467e-a37c-31ddf30a549c tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:31:41.716181 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-0b443313-e3d7-467e-a37c-31ddf30a549c tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: bb839e22-971b-4313-be06-20e09838215a] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:31:41.730125 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-0b443313-e3d7-467e-a37c-31ddf30a549c tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:41.734909 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-0b443313-e3d7-467e-a37c-31ddf30a549c tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:41.737086 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-0b443313-e3d7-467e-a37c-31ddf30a549c tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:41.739879 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-0b443313-e3d7-467e-a37c-31ddf30a549c tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:41.910522 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-76414e55-b55e-4bd4-8211-a2fd382c54b0 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:31:41.930065 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-76414e55-b55e-4bd4-8211-a2fd382c54b0 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:31:41.938569 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-76414e55-b55e-4bd4-8211-a2fd382c54b0 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:31:41.941646 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-76414e55-b55e-4bd4-8211-a2fd382c54b0 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1340 microversion: 2.20 time: 0.318802 May 19 13:31:41.946390 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 35/59] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:31:41 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1340 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:31:41.969525 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-5702fc67-4bae-4c48-832b-3ebf5cbfd556 tempest-VolumesGetTestJSON-344457794 tempest-VolumesGetTestJSON-344457794-project] Calling method '.version_select at 0x7f7c2c4fd0d0>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:31:42.086843 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-5702fc67-4bae-4c48-832b-3ebf5cbfd556 tempest-VolumesGetTestJSON-344457794 tempest-VolumesGetTestJSON-344457794-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/5c6aeaa8-c544-4b61-bd63-f863dc480f84" status: 200 len: 353 microversion: 2.1 time: 0.136705 May 19 13:31:42.087496 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 36/60] 10.222.0.24 () {58 vars in 1244 bytes} [Thu May 19 13:31:41 2022] GET /compute/v2.1/os-volumes/5c6aeaa8-c544-4b61-bd63-f863dc480f84 => generated 353 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:31:42.726793 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-74d02744-dbed-467a-a277-31f37774195d tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:31:42.729036 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-74d02744-dbed-467a-a277-31f37774195d tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] [instance: 080936a4-151d-4f4b-a750-937d342729db] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:31:42.749956 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-74d02744-dbed-467a-a277-31f37774195d tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:42.754259 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-74d02744-dbed-467a-a277-31f37774195d tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:42.760072 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-74d02744-dbed-467a-a277-31f37774195d tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:42.760350 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-74d02744-dbed-467a-a277-31f37774195d tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:42.848735 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-0b443313-e3d7-467e-a37c-31ddf30a549c tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:31:42.857601 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-0b443313-e3d7-467e-a37c-31ddf30a549c tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a" status: 200 len: 1218 microversion: 2.1 time: 1.147020 May 19 13:31:42.862912 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 25/61] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:31:41 2022] GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a => generated 1218 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:31:42.964832 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-524380dd-13f7-4d16-88a0-6a6487fd4989 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:31:42.965481 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-524380dd-13f7-4d16-88a0-6a6487fd4989 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:31:42.978035 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-524380dd-13f7-4d16-88a0-6a6487fd4989 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:42.983344 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-524380dd-13f7-4d16-88a0-6a6487fd4989 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:42.986534 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-524380dd-13f7-4d16-88a0-6a6487fd4989 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:42.986996 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-524380dd-13f7-4d16-88a0-6a6487fd4989 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:43.373975 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-74d02744-dbed-467a-a277-31f37774195d tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ceb5b9477e431ba4a01adf2f3f485a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b09e85301c4e349b6714b13ae2e955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:31:43.408966 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-74d02744-dbed-467a-a277-31f37774195d tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] 10.222.0.24 "GET /compute/v2.1/servers/080936a4-151d-4f4b-a750-937d342729db" status: 200 len: 1315 microversion: 2.1 time: 0.685643 May 19 13:31:43.422022 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 37/62] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:31:42 2022] GET /compute/v2.1/servers/080936a4-151d-4f4b-a750-937d342729db => generated 1315 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:31:43.432298 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-4f21adee-90e3-4ccf-abf4-5436d853e0e9 tempest-VolumesGetTestJSON-344457794 tempest-VolumesGetTestJSON-344457794-project] Calling method '.version_select at 0x7f7c2c475f70>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:31:43.567431 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-4f21adee-90e3-4ccf-abf4-5436d853e0e9 tempest-VolumesGetTestJSON-344457794 tempest-VolumesGetTestJSON-344457794-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/5c6aeaa8-c544-4b61-bd63-f863dc480f84" status: 200 len: 354 microversion: 2.1 time: 0.137363 May 19 13:31:43.568398 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 38/63] 10.222.0.24 () {58 vars in 1244 bytes} [Thu May 19 13:31:43 2022] GET /compute/v2.1/os-volumes/5c6aeaa8-c544-4b61-bd63-f863dc480f84 => generated 354 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:31:43.856708 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [req-a5954cc0-c67d-416e-a3df-c0fcd7528f22 req-461d49ae-e91a-4117-9244-16f9d0c98c51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "080936a4-151d-4f4b-a750-937d342729db", "tag": "fdf6572a-31e1-4e19-9111-37d73967c97d"}]} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:31:43.893064 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-a5954cc0-c67d-416e-a3df-c0fcd7528f22 req-461d49ae-e91a-4117-9244-16f9d0c98c51 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:43.894401 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-a5954cc0-c67d-416e-a3df-c0fcd7528f22 req-461d49ae-e91a-4117-9244-16f9d0c98c51 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:43.925040 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.compute.server_external_events [req-a5954cc0-c67d-416e-a3df-c0fcd7528f22 req-461d49ae-e91a-4117-9244-16f9d0c98c51 service nova] Creating event network-changed:fdf6572a-31e1-4e19-9111-37d73967c97d for instance 080936a4-151d-4f4b-a750-937d342729db on hv-cinder-84112 May 19 13:31:43.928524 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-a5954cc0-c67d-416e-a3df-c0fcd7528f22 req-461d49ae-e91a-4117-9244-16f9d0c98c51 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120471) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 19 13:31:43.930457 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-776ffbd1-938a-44cd-b082-ea32315fb141 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:43.931007 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-776ffbd1-938a-44cd-b082-ea32315fb141 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:43.937879 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-776ffbd1-938a-44cd-b082-ea32315fb141 None None] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:43.938386 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-776ffbd1-938a-44cd-b082-ea32315fb141 None None] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:43.950510 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.compute.rpcapi [None req-776ffbd1-938a-44cd-b082-ea32315fb141 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 19 13:31:43.951697 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-776ffbd1-938a-44cd-b082-ea32315fb141 None None] Releasing lock "compute-rpcapi-router" {{(pid=120471) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 19 13:31:43.996477 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-776ffbd1-938a-44cd-b082-ea32315fb141 None None] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.426113 May 19 13:31:43.997081 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 39/64] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:31:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:31:44.003253 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-ede6b984-c86c-460f-8659-121ed1856835 tempest-VolumesGetTestJSON-344457794 tempest-VolumesGetTestJSON-344457794-project] Calling method '.version_select at 0x7f7c2c36e670>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:31:44.169187 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-ede6b984-c86c-460f-8659-121ed1856835 tempest-VolumesGetTestJSON-344457794 tempest-VolumesGetTestJSON-344457794-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/5c6aeaa8-c544-4b61-bd63-f863dc480f84" status: 200 len: 354 microversion: 2.1 time: 0.170852 May 19 13:31:44.170172 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 40/65] 10.222.0.24 () {58 vars in 1244 bytes} [Thu May 19 13:31:43 2022] GET /compute/v2.1/os-volumes/5c6aeaa8-c544-4b61-bd63-f863dc480f84 => generated 354 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:31:44.175629 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-9945c3a3-51a1-4ee9-ba53-4ab46fdab0f6 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:31:44.177681 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-9945c3a3-51a1-4ee9-ba53-4ab46fdab0f6 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: bb839e22-971b-4313-be06-20e09838215a] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:31:44.207609 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-9945c3a3-51a1-4ee9-ba53-4ab46fdab0f6 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:44.216878 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-9945c3a3-51a1-4ee9-ba53-4ab46fdab0f6 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:44.220023 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-9945c3a3-51a1-4ee9-ba53-4ab46fdab0f6 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:44.222463 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-9945c3a3-51a1-4ee9-ba53-4ab46fdab0f6 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:44.455868 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-9945c3a3-51a1-4ee9-ba53-4ab46fdab0f6 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:31:44.468528 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-9945c3a3-51a1-4ee9-ba53-4ab46fdab0f6 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a" status: 200 len: 1280 microversion: 2.1 time: 0.296954 May 19 13:31:44.469119 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 41/66] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:31:44 2022] GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a => generated 1280 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:31:44.486681 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-91b5c425-d88c-433c-832e-72dbd231c3e5 tempest-VolumesGetTestJSON-344457794 tempest-VolumesGetTestJSON-344457794-project] Calling method '.version_select at 0x7f7c2bb0ca60>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:31:44.613628 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-91b5c425-d88c-433c-832e-72dbd231c3e5 tempest-VolumesGetTestJSON-344457794 tempest-VolumesGetTestJSON-344457794-project] 10.222.0.24 "DELETE /compute/v2.1/os-volumes/5c6aeaa8-c544-4b61-bd63-f863dc480f84" status: 202 len: 0 microversion: 2.1 time: 0.135356 May 19 13:31:44.615759 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 42/67] 10.222.0.24 () {58 vars in 1247 bytes} [Thu May 19 13:31:44 2022] DELETE /compute/v2.1/os-volumes/5c6aeaa8-c544-4b61-bd63-f863dc480f84 => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 13:31:44.642355 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-072766fb-2f93-4b99-9ffa-04ebb9af45dd tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:31:44.648840 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-072766fb-2f93-4b99-9ffa-04ebb9af45dd tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] [instance: 080936a4-151d-4f4b-a750-937d342729db] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:31:44.681546 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-072766fb-2f93-4b99-9ffa-04ebb9af45dd tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:44.682537 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-072766fb-2f93-4b99-9ffa-04ebb9af45dd tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:44.687695 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-072766fb-2f93-4b99-9ffa-04ebb9af45dd tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:44.690763 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-072766fb-2f93-4b99-9ffa-04ebb9af45dd tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:44.983568 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-524380dd-13f7-4d16-88a0-6a6487fd4989 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:31:44.992366 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-524380dd-13f7-4d16-88a0-6a6487fd4989 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:31:44.997633 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-524380dd-13f7-4d16-88a0-6a6487fd4989 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:31:45.005954 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-524380dd-13f7-4d16-88a0-6a6487fd4989 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1407 microversion: 2.20 time: 2.045486 May 19 13:31:45.007880 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 26/68] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:31:42 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1407 bytes in 2048 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 13:31:45.020600 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-cf3fe225-336a-4677-a17b-807e7128bb1e tempest-VolumesGetTestJSON-344457794 tempest-VolumesGetTestJSON-344457794-project] Calling method '.version_select at 0x7f7c2aab0ee0>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:31:45.079968 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.wsgi [None req-cf3fe225-336a-4677-a17b-807e7128bb1e tempest-VolumesGetTestJSON-344457794 tempest-VolumesGetTestJSON-344457794-project] HTTP exception thrown: Volume 5c6aeaa8-c544-4b61-bd63-f863dc480f84 could not be found. May 19 13:31:45.082272 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-cf3fe225-336a-4677-a17b-807e7128bb1e tempest-VolumesGetTestJSON-344457794 tempest-VolumesGetTestJSON-344457794-project] Request method failure captured: May 19 13:31:45.082272 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: request: GET /compute/v2.1/os-volumes/5c6aeaa8-c544-4b61-bd63-f863dc480f84 HTTP/1.1 May 19 13:31:45.082272 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Accept: application/json May 19 13:31:45.082272 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Accept-Encoding: identity May 19 13:31:45.082272 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Connection: close May 19 13:31:45.082272 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Content-Length: 0 May 19 13:31:45.082272 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Content-Type: application/json May 19 13:31:45.082272 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Host: 10.222.0.24 May 19 13:31:45.082272 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Openstack-System-Scope: None May 19 13:31:45.082272 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: User-Agent: python-urllib3/1.26.9 May 19 13:31:45.082272 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Auth-Token: gAAAAABihka75mNfabN5gEqvB2AQdaQzT1hCINby4_LfRCE5XtP4-ZE-g1UIqJfFegObgS0zsgS3jUa8Tm5ZEKxcYvPl7nqhXVK23rLgooiNhMywuQGcgvcqPe1cfP7LCfFaHUbK6xG2PbI36abrzMu-kw8gtPjSzxZllzALHKU1INlsXD5Vzzs May 19 13:31:45.082272 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Domain-Id: None May 19 13:31:45.082272 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Domain-Name: None May 19 13:31:45.082272 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Identity-Status: Confirmed May 19 13:31:45.082272 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Is-Admin-Project: True May 19 13:31:45.082272 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Domain-Id: default May 19 13:31:45.082272 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Domain-Name: Default May 19 13:31:45.082272 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Id: c7c73b53e1e140b281f590dd5f33e3a4 May 19 13:31:45.082272 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Name: tempest-VolumesGetTestJSON-344457794 May 19 13:31:45.082272 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Role: reader,member May 19 13:31:45.082272 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Roles: reader,member May 19 13:31:45.083648 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/c7c73b53e1e140b281f590dd5f33e3a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/c7c73b53e1e140b281f590dd5f33e3a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_c7c73b53e1e140b281f590dd5f33e3a4", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/c7c73b53e1e140b281f590dd5f33e3a4"}]}] May 19 13:31:45.083648 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant: tempest-VolumesGetTestJSON-344457794 May 19 13:31:45.083648 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant-Id: c7c73b53e1e140b281f590dd5f33e3a4 May 19 13:31:45.083648 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant-Name: tempest-VolumesGetTestJSON-344457794 May 19 13:31:45.083648 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User: tempest-VolumesGetTestJSON-344457794-project May 19 13:31:45.083648 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Domain-Id: default May 19 13:31:45.083648 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Domain-Name: Default May 19 13:31:45.083648 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Id: 0a56dae1b5c547d3af68ade6ab7cd467 May 19 13:31:45.083648 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Name: tempest-VolumesGetTestJSON-344457794-project May 19 13:31:45.083648 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: method: May 19 13:31:45.083648 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: exception: Volume 5c6aeaa8-c544-4b61-bd63-f863dc480f84 could not be found. May 19 13:31:45.083648 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: action_args: {'id': '5c6aeaa8-c544-4b61-bd63-f863dc480f84'} May 19 13:31:45.083648 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:31:45.084511 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:31:45.084511 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 13:31:45.084511 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 13:31:45.084511 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 19 13:31:45.084511 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi item = cinderclient( May 19 13:31:45.084511 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 19 13:31:45.084511 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 19 13:31:45.084511 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 13:31:45.084511 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 13:31:45.084511 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 13:31:45.084511 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 13:31:45.084511 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 13:31:45.084511 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 13:31:45.084511 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 13:31:45.084511 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 13:31:45.084511 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5c6aeaa8-c544-4b61-bd63-f863dc480f84 could not be found. (HTTP 404) (Request-ID: req-bad334e8-2edb-44d2-aa07-747641244257) May 19 13:31:45.084511 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:31:45.084511 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:31:45.084511 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:31:45.085759 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:31:45.085759 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 19 13:31:45.085759 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 19 13:31:45.085759 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 19 13:31:45.085759 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 19 13:31:45.085759 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 19 13:31:45.085759 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 19 13:31:45.085759 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 19 13:31:45.085759 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 19 13:31:45.085759 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 13:31:45.085759 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 13:31:45.085759 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 19 13:31:45.085759 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi item = cinderclient( May 19 13:31:45.085759 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 19 13:31:45.085759 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 19 13:31:45.085759 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 13:31:45.085759 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 13:31:45.085759 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 13:31:45.085759 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 13:31:45.086913 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 13:31:45.086913 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 13:31:45.086913 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 13:31:45.086913 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 13:31:45.086913 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5c6aeaa8-c544-4b61-bd63-f863dc480f84 could not be found. May 19 13:31:45.086913 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:31:45.086913 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:31:45.086913 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:31:45.086913 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:31:45.086913 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:31:45.086913 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:31:45.086913 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:31:45.086913 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:31:45.086913 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 13:31:45.086913 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 13:31:45.086913 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:31:45.086913 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:31:45.086913 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 19 13:31:45.086913 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 13:31:45.088250 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5c6aeaa8-c544-4b61-bd63-f863dc480f84 could not be found. May 19 13:31:45.088250 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:31:45.088250 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:31:45.088250 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:31:45.088250 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:31:45.088250 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:31:45.088250 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:31:45.088250 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:31:45.088250 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:31:45.088250 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5c6aeaa8-c544-4b61-bd63-f863dc480f84 could not be found. May 19 13:31:45.088250 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:31:45.089960 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-cf3fe225-336a-4677-a17b-807e7128bb1e tempest-VolumesGetTestJSON-344457794 tempest-VolumesGetTestJSON-344457794-project] Returning 404 to user: Volume 5c6aeaa8-c544-4b61-bd63-f863dc480f84 could not be found. {{(pid=120472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:31:45.092721 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-cf3fe225-336a-4677-a17b-807e7128bb1e tempest-VolumesGetTestJSON-344457794 tempest-VolumesGetTestJSON-344457794-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/5c6aeaa8-c544-4b61-bd63-f863dc480f84" status: 404 len: 109 microversion: 2.1 time: 0.080644 May 19 13:31:45.094820 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 27/69] 10.222.0.24 () {58 vars in 1244 bytes} [Thu May 19 13:31:45 2022] GET /compute/v2.1/os-volumes/5c6aeaa8-c544-4b61-bd63-f863dc480f84 => generated 109 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 13:31:45.154946 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-072766fb-2f93-4b99-9ffa-04ebb9af45dd tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ceb5b9477e431ba4a01adf2f3f485a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b09e85301c4e349b6714b13ae2e955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:31:45.169031 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-072766fb-2f93-4b99-9ffa-04ebb9af45dd tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] 10.222.0.24 "GET /compute/v2.1/servers/080936a4-151d-4f4b-a750-937d342729db" status: 200 len: 1315 microversion: 2.1 time: 0.551209 May 19 13:31:45.169853 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 43/70] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:31:44 2022] GET /compute/v2.1/servers/080936a4-151d-4f4b-a750-937d342729db => generated 1315 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:31:45.490158 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-58c0435c-9c68-4301-a529-877e60468183 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:31:45.490975 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-58c0435c-9c68-4301-a529-877e60468183 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: bb839e22-971b-4313-be06-20e09838215a] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:31:45.515875 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-58c0435c-9c68-4301-a529-877e60468183 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:45.519903 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-58c0435c-9c68-4301-a529-877e60468183 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:45.521850 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-58c0435c-9c68-4301-a529-877e60468183 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:45.522530 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-58c0435c-9c68-4301-a529-877e60468183 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:46.024188 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-2985eda0-15bd-460a-8cb6-e51b4736f82b tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:31:46.025372 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-2985eda0-15bd-460a-8cb6-e51b4736f82b tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:31:46.042113 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-2985eda0-15bd-460a-8cb6-e51b4736f82b tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:46.042674 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-2985eda0-15bd-460a-8cb6-e51b4736f82b tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:46.043645 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-2985eda0-15bd-460a-8cb6-e51b4736f82b tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:46.044139 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-2985eda0-15bd-460a-8cb6-e51b4736f82b tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:46.053039 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-58c0435c-9c68-4301-a529-877e60468183 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:31:46.069958 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-58c0435c-9c68-4301-a529-877e60468183 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a" status: 200 len: 1280 microversion: 2.1 time: 0.586498 May 19 13:31:46.070520 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 28/71] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:31:45 2022] GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a => generated 1280 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:31:46.196143 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-53092e3e-77dd-49bc-a6a4-9e6ba11f0a38 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:31:46.196938 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-53092e3e-77dd-49bc-a6a4-9e6ba11f0a38 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] [instance: 080936a4-151d-4f4b-a750-937d342729db] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:31:46.205473 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-53092e3e-77dd-49bc-a6a4-9e6ba11f0a38 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:46.205931 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-53092e3e-77dd-49bc-a6a4-9e6ba11f0a38 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:46.206703 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-53092e3e-77dd-49bc-a6a4-9e6ba11f0a38 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:46.207142 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-53092e3e-77dd-49bc-a6a4-9e6ba11f0a38 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:46.346610 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_cell0:SELECT=10 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:31:46.631307 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-53092e3e-77dd-49bc-a6a4-9e6ba11f0a38 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ceb5b9477e431ba4a01adf2f3f485a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b09e85301c4e349b6714b13ae2e955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:31:46.645698 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-53092e3e-77dd-49bc-a6a4-9e6ba11f0a38 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] 10.222.0.24 "GET /compute/v2.1/servers/080936a4-151d-4f4b-a750-937d342729db" status: 200 len: 1315 microversion: 2.1 time: 0.454465 May 19 13:31:46.647479 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 29/72] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:31:46 2022] GET /compute/v2.1/servers/080936a4-151d-4f4b-a750-937d342729db => generated 1315 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:31:46.668628 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-2985eda0-15bd-460a-8cb6-e51b4736f82b tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:31:46.710201 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-2985eda0-15bd-460a-8cb6-e51b4736f82b tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:31:46.714386 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-2985eda0-15bd-460a-8cb6-e51b4736f82b tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:31:46.719715 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-2985eda0-15bd-460a-8cb6-e51b4736f82b tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1407 microversion: 2.20 time: 0.698094 May 19 13:31:46.721458 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 44/73] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:31:46 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1407 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:31:47.088006 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-6c4f9ab2-8dfc-45d7-a4f3-5722a84ab85f tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:31:47.089802 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-6c4f9ab2-8dfc-45d7-a4f3-5722a84ab85f tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: bb839e22-971b-4313-be06-20e09838215a] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:31:47.110308 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=13 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:31:47.113891 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-6c4f9ab2-8dfc-45d7-a4f3-5722a84ab85f tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:47.123707 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-6c4f9ab2-8dfc-45d7-a4f3-5722a84ab85f tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:47.125236 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-6c4f9ab2-8dfc-45d7-a4f3-5722a84ab85f tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:47.126431 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-6c4f9ab2-8dfc-45d7-a4f3-5722a84ab85f tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:47.290447 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-6c4f9ab2-8dfc-45d7-a4f3-5722a84ab85f tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:31:47.317033 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-6c4f9ab2-8dfc-45d7-a4f3-5722a84ab85f tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a" status: 200 len: 1280 microversion: 2.1 time: 0.233335 May 19 13:31:47.319990 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 30/74] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:31:47 2022] GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a => generated 1280 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:31:47.664064 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-b349a232-5052-438f-8e1d-026dd5d57b41 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:31:47.665498 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-b349a232-5052-438f-8e1d-026dd5d57b41 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] [instance: 080936a4-151d-4f4b-a750-937d342729db] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:31:47.682241 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-b349a232-5052-438f-8e1d-026dd5d57b41 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:47.685674 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-b349a232-5052-438f-8e1d-026dd5d57b41 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:47.689674 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-b349a232-5052-438f-8e1d-026dd5d57b41 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:47.693159 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-b349a232-5052-438f-8e1d-026dd5d57b41 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:47.741209 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-34074fff-2e44-49a3-bbe0-db755ddad19f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:31:47.747204 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-34074fff-2e44-49a3-bbe0-db755ddad19f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:31:47.761139 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-34074fff-2e44-49a3-bbe0-db755ddad19f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:47.761795 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-34074fff-2e44-49a3-bbe0-db755ddad19f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:47.762996 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-34074fff-2e44-49a3-bbe0-db755ddad19f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:47.764915 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-34074fff-2e44-49a3-bbe0-db755ddad19f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:47.776731 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_cell1:SELECT=51 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:31:48.082100 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-b349a232-5052-438f-8e1d-026dd5d57b41 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ceb5b9477e431ba4a01adf2f3f485a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b09e85301c4e349b6714b13ae2e955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:31:48.090508 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-b349a232-5052-438f-8e1d-026dd5d57b41 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] 10.222.0.24 "GET /compute/v2.1/servers/080936a4-151d-4f4b-a750-937d342729db" status: 200 len: 1315 microversion: 2.1 time: 0.430873 May 19 13:31:48.094469 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 45/75] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:31:47 2022] GET /compute/v2.1/servers/080936a4-151d-4f4b-a750-937d342729db => generated 1315 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:31:48.335493 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-a0942b30-fe70-49f7-acc3-13f9f103ef35 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:31:48.336197 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-a0942b30-fe70-49f7-acc3-13f9f103ef35 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: bb839e22-971b-4313-be06-20e09838215a] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:31:48.352190 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-a0942b30-fe70-49f7-acc3-13f9f103ef35 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:48.352831 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-a0942b30-fe70-49f7-acc3-13f9f103ef35 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:48.353811 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-a0942b30-fe70-49f7-acc3-13f9f103ef35 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:48.359616 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-a0942b30-fe70-49f7-acc3-13f9f103ef35 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:48.682165 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-a0942b30-fe70-49f7-acc3-13f9f103ef35 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:31:48.691568 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-a0942b30-fe70-49f7-acc3-13f9f103ef35 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a" status: 200 len: 1322 microversion: 2.1 time: 0.361274 May 19 13:31:48.692641 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 46/76] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:31:48 2022] GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a => generated 1322 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:31:48.955571 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-34074fff-2e44-49a3-bbe0-db755ddad19f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:31:48.965308 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-34074fff-2e44-49a3-bbe0-db755ddad19f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:31:48.967115 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-34074fff-2e44-49a3-bbe0-db755ddad19f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:31:48.968271 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-34074fff-2e44-49a3-bbe0-db755ddad19f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1407 microversion: 2.20 time: 1.232962 May 19 13:31:48.968833 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 31/77] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:31:47 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1407 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 13:31:49.111395 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-c0919125-1605-4037-b0d2-f7a6dcdbd80d tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:31:49.111979 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-c0919125-1605-4037-b0d2-f7a6dcdbd80d tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] [instance: 080936a4-151d-4f4b-a750-937d342729db] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:31:49.119985 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_api:SELECT=51 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:31:49.123837 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-c0919125-1605-4037-b0d2-f7a6dcdbd80d tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:49.132350 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-c0919125-1605-4037-b0d2-f7a6dcdbd80d tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:49.133230 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-c0919125-1605-4037-b0d2-f7a6dcdbd80d tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:49.133642 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-c0919125-1605-4037-b0d2-f7a6dcdbd80d tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:49.567307 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-c0919125-1605-4037-b0d2-f7a6dcdbd80d tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ceb5b9477e431ba4a01adf2f3f485a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b09e85301c4e349b6714b13ae2e955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:31:49.578970 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-c0919125-1605-4037-b0d2-f7a6dcdbd80d tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] 10.222.0.24 "GET /compute/v2.1/servers/080936a4-151d-4f4b-a750-937d342729db" status: 200 len: 1315 microversion: 2.1 time: 0.471225 May 19 13:31:49.581728 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 47/78] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:31:49 2022] GET /compute/v2.1/servers/080936a4-151d-4f4b-a750-937d342729db => generated 1315 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:31:49.631857 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_cell0:SELECT=8 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:31:49.710864 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-88f936c0-0522-4881-be6f-97decd832b65 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:31:49.711350 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [req-b52e9519-6900-407a-8dfc-abc1406cfc1f req-e94e12bd-9c46-468c-8b2d-b29539d0b045 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "323322ec-2e2e-424b-a411-8a34069bcf10", "tag": "1ae6b782-184e-4357-ab26-9a0648e0a6a3"}]} {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:31:49.711622 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-88f936c0-0522-4881-be6f-97decd832b65 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: bb839e22-971b-4313-be06-20e09838215a] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:31:49.720691 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-88f936c0-0522-4881-be6f-97decd832b65 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:49.722446 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-88f936c0-0522-4881-be6f-97decd832b65 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:49.724530 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-88f936c0-0522-4881-be6f-97decd832b65 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:49.726928 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-88f936c0-0522-4881-be6f-97decd832b65 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:49.738037 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [req-b52e9519-6900-407a-8dfc-abc1406cfc1f req-e94e12bd-9c46-468c-8b2d-b29539d0b045 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:49.738485 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [req-b52e9519-6900-407a-8dfc-abc1406cfc1f req-e94e12bd-9c46-468c-8b2d-b29539d0b045 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:49.814771 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.compute.server_external_events [req-b52e9519-6900-407a-8dfc-abc1406cfc1f req-e94e12bd-9c46-468c-8b2d-b29539d0b045 service nova] Creating event network-changed:1ae6b782-184e-4357-ab26-9a0648e0a6a3 for instance 323322ec-2e2e-424b-a411-8a34069bcf10 on hv-cinder-84112 May 19 13:31:49.815331 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [req-b52e9519-6900-407a-8dfc-abc1406cfc1f req-e94e12bd-9c46-468c-8b2d-b29539d0b045 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120472) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 19 13:31:49.825714 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-78b11e4b-7c0a-4814-b89c-3481e4814884 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:49.826378 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-78b11e4b-7c0a-4814-b89c-3481e4814884 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:49.840381 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-78b11e4b-7c0a-4814-b89c-3481e4814884 None None] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:49.840853 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-78b11e4b-7c0a-4814-b89c-3481e4814884 None None] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:49.875178 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.compute.rpcapi [None req-78b11e4b-7c0a-4814-b89c-3481e4814884 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 19 13:31:49.876445 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-78b11e4b-7c0a-4814-b89c-3481e4814884 None None] Releasing lock "compute-rpcapi-router" {{(pid=120472) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 19 13:31:49.927003 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-78b11e4b-7c0a-4814-b89c-3481e4814884 None None] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.449122 May 19 13:31:49.929941 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 32/79] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:31:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 13:31:49.938859 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [req-f1ec2036-3090-487c-aba7-ce2cd818f5ba req-0f0b6ed5-0fb7-4b56-ba97-0414297f83a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb839e22-971b-4313-be06-20e09838215a", "tag": "ea2cc4f1-cac0-4395-b583-23d210e4ca9b"}]} {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:31:49.967713 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [req-f1ec2036-3090-487c-aba7-ce2cd818f5ba req-0f0b6ed5-0fb7-4b56-ba97-0414297f83a2 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:49.968344 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [req-f1ec2036-3090-487c-aba7-ce2cd818f5ba req-0f0b6ed5-0fb7-4b56-ba97-0414297f83a2 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:50.007410 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.compute.server_external_events [req-f1ec2036-3090-487c-aba7-ce2cd818f5ba req-0f0b6ed5-0fb7-4b56-ba97-0414297f83a2 service nova] Creating event network-changed:ea2cc4f1-cac0-4395-b583-23d210e4ca9b for instance bb839e22-971b-4313-be06-20e09838215a on hv-cinder-84112 May 19 13:31:50.020213 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [req-f1ec2036-3090-487c-aba7-ce2cd818f5ba req-0f0b6ed5-0fb7-4b56-ba97-0414297f83a2 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088605 May 19 13:31:50.022538 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 33/80] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:31:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:31:50.037761 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-98f10cae-ac23-4a42-b28e-1bf80bf7565d tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:31:50.039378 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-98f10cae-ac23-4a42-b28e-1bf80bf7565d tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:31:50.054364 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-98f10cae-ac23-4a42-b28e-1bf80bf7565d tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:50.056637 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-98f10cae-ac23-4a42-b28e-1bf80bf7565d tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:50.057719 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-98f10cae-ac23-4a42-b28e-1bf80bf7565d tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:50.063844 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-98f10cae-ac23-4a42-b28e-1bf80bf7565d tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:50.413108 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_cell0:SELECT=32 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:31:50.826217 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-88f936c0-0522-4881-be6f-97decd832b65 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:31:50.837453 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_cell1:SELECT=100 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:31:50.844797 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-88f936c0-0522-4881-be6f-97decd832b65 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a" status: 200 len: 1322 microversion: 2.1 time: 1.140224 May 19 13:31:50.858971 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 48/81] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:31:49 2022] GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a => generated 1322 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:31:50.873607 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-fde4eedd-2266-4e33-883c-eafb1bfbadc0 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:31:50.874576 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-fde4eedd-2266-4e33-883c-eafb1bfbadc0 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] [instance: 080936a4-151d-4f4b-a750-937d342729db] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:31:50.897800 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-fde4eedd-2266-4e33-883c-eafb1bfbadc0 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:50.901093 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-fde4eedd-2266-4e33-883c-eafb1bfbadc0 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:50.902146 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-fde4eedd-2266-4e33-883c-eafb1bfbadc0 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:50.903080 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-fde4eedd-2266-4e33-883c-eafb1bfbadc0 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:51.175556 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-98f10cae-ac23-4a42-b28e-1bf80bf7565d tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:31:51.186793 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-98f10cae-ac23-4a42-b28e-1bf80bf7565d tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:31:51.190267 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-98f10cae-ac23-4a42-b28e-1bf80bf7565d tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:31:51.193947 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-98f10cae-ac23-4a42-b28e-1bf80bf7565d tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1407 microversion: 2.20 time: 1.167711 May 19 13:31:51.199614 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 34/82] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:31:50 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1407 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:31:51.282996 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-fde4eedd-2266-4e33-883c-eafb1bfbadc0 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ceb5b9477e431ba4a01adf2f3f485a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b09e85301c4e349b6714b13ae2e955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:31:51.293844 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-fde4eedd-2266-4e33-883c-eafb1bfbadc0 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] 10.222.0.24 "GET /compute/v2.1/servers/080936a4-151d-4f4b-a750-937d342729db" status: 200 len: 1315 microversion: 2.1 time: 0.432672 May 19 13:31:51.294975 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 49/83] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:31:50 2022] GET /compute/v2.1/servers/080936a4-151d-4f4b-a750-937d342729db => generated 1315 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:31:51.875548 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-8611fbd9-a889-48b5-a166-d23919681c88 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:31:51.876487 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-8611fbd9-a889-48b5-a166-d23919681c88 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: bb839e22-971b-4313-be06-20e09838215a] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:31:51.890099 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-8611fbd9-a889-48b5-a166-d23919681c88 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:51.894762 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-8611fbd9-a889-48b5-a166-d23919681c88 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:51.895755 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-8611fbd9-a889-48b5-a166-d23919681c88 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:51.900774 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-8611fbd9-a889-48b5-a166-d23919681c88 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:51.972213 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [req-2e142300-72be-43b6-a1ab-4ccd0a17b815 req-90e566e9-ec49-467f-9f20-e0612653e8f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4c1abc9-8651-4788-9650-27704ae7e306", "tag": "700b033c-2fd5-4b02-a577-7fa27ba29508"}]} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:31:51.988824 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-2e142300-72be-43b6-a1ab-4ccd0a17b815 req-90e566e9-ec49-467f-9f20-e0612653e8f0 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:51.989256 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-2e142300-72be-43b6-a1ab-4ccd0a17b815 req-90e566e9-ec49-467f-9f20-e0612653e8f0 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:52.045037 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.compute.server_external_events [req-2e142300-72be-43b6-a1ab-4ccd0a17b815 req-90e566e9-ec49-467f-9f20-e0612653e8f0 service nova] Creating event network-changed:700b033c-2fd5-4b02-a577-7fa27ba29508 for instance c4c1abc9-8651-4788-9650-27704ae7e306 on hv-cinder-84112 May 19 13:31:52.059212 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [req-2e142300-72be-43b6-a1ab-4ccd0a17b815 req-90e566e9-ec49-467f-9f20-e0612653e8f0 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090444 May 19 13:31:52.060186 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 50/84] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:31:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:31:52.218847 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-1220849a-ef32-40b7-a9b4-bc348458c599 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:31:52.220328 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-1220849a-ef32-40b7-a9b4-bc348458c599 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:31:52.235830 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-1220849a-ef32-40b7-a9b4-bc348458c599 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:52.238558 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-1220849a-ef32-40b7-a9b4-bc348458c599 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:52.239611 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-1220849a-ef32-40b7-a9b4-bc348458c599 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:52.240242 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-1220849a-ef32-40b7-a9b4-bc348458c599 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:52.496787 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-8611fbd9-a889-48b5-a166-d23919681c88 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:31:52.508363 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-8611fbd9-a889-48b5-a166-d23919681c88 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a" status: 200 len: 1322 microversion: 2.1 time: 0.636996 May 19 13:31:52.509405 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 35/85] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:31:51 2022] GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a => generated 1322 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:31:52.517219 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-be187ae1-59f8-4c97-af88-472b0b4fadc0 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:31:52.518066 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-be187ae1-59f8-4c97-af88-472b0b4fadc0 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] [instance: 080936a4-151d-4f4b-a750-937d342729db] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:31:52.527741 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-be187ae1-59f8-4c97-af88-472b0b4fadc0 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:52.528744 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-be187ae1-59f8-4c97-af88-472b0b4fadc0 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:52.529849 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-be187ae1-59f8-4c97-af88-472b0b4fadc0 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:52.531887 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-be187ae1-59f8-4c97-af88-472b0b4fadc0 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:52.587203 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-1220849a-ef32-40b7-a9b4-bc348458c599 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:31:52.595988 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-1220849a-ef32-40b7-a9b4-bc348458c599 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:31:52.597744 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-1220849a-ef32-40b7-a9b4-bc348458c599 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:31:52.598958 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-1220849a-ef32-40b7-a9b4-bc348458c599 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1407 microversion: 2.20 time: 0.385584 May 19 13:31:52.599723 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 51/86] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:31:52 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1407 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 13:31:52.678269 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [req-c0c94067-e608-4a71-8021-52990b1dd7e0 req-8777a771-abd0-4275-b0ab-b04bc12cbc52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "080936a4-151d-4f4b-a750-937d342729db", "name": "network-vif-plugged", "status": "completed", "tag": "fdf6572a-31e1-4e19-9111-37d73967c97d"}]} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:31:52.687917 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-c0c94067-e608-4a71-8021-52990b1dd7e0 req-8777a771-abd0-4275-b0ab-b04bc12cbc52 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:52.688438 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-c0c94067-e608-4a71-8021-52990b1dd7e0 req-8777a771-abd0-4275-b0ab-b04bc12cbc52 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:52.729185 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.compute.server_external_events [req-c0c94067-e608-4a71-8021-52990b1dd7e0 req-8777a771-abd0-4275-b0ab-b04bc12cbc52 service nova] Creating event network-vif-plugged:fdf6572a-31e1-4e19-9111-37d73967c97d for instance 080936a4-151d-4f4b-a750-937d342729db on hv-cinder-84112 May 19 13:31:52.739700 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [req-c0c94067-e608-4a71-8021-52990b1dd7e0 req-8777a771-abd0-4275-b0ab-b04bc12cbc52 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138556 May 19 13:31:52.740707 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 52/87] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:31:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:31:52.816028 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-be187ae1-59f8-4c97-af88-472b0b4fadc0 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ceb5b9477e431ba4a01adf2f3f485a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b09e85301c4e349b6714b13ae2e955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:31:52.823719 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-be187ae1-59f8-4c97-af88-472b0b4fadc0 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] 10.222.0.24 "GET /compute/v2.1/servers/080936a4-151d-4f4b-a750-937d342729db" status: 200 len: 1315 microversion: 2.1 time: 0.312105 May 19 13:31:52.832417 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 36/88] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:31:52 2022] GET /compute/v2.1/servers/080936a4-151d-4f4b-a750-937d342729db => generated 1315 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:31:53.551333 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-b9c50b53-00f7-4f08-bcee-4477516b9910 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:31:53.569544 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-b9c50b53-00f7-4f08-bcee-4477516b9910 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: bb839e22-971b-4313-be06-20e09838215a] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:31:53.609578 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-b9c50b53-00f7-4f08-bcee-4477516b9910 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:53.610327 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-b9c50b53-00f7-4f08-bcee-4477516b9910 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:53.611101 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-b9c50b53-00f7-4f08-bcee-4477516b9910 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:53.611601 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-b9c50b53-00f7-4f08-bcee-4477516b9910 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:53.627126 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-4563b814-41b1-471c-afd6-27e6d05e7102 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:31:53.629889 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-4563b814-41b1-471c-afd6-27e6d05e7102 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:31:53.648791 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-4563b814-41b1-471c-afd6-27e6d05e7102 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:53.649451 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-4563b814-41b1-471c-afd6-27e6d05e7102 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:53.650967 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-4563b814-41b1-471c-afd6-27e6d05e7102 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:53.651581 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-4563b814-41b1-471c-afd6-27e6d05e7102 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:53.926289 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-4563b814-41b1-471c-afd6-27e6d05e7102 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:31:53.939913 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-4563b814-41b1-471c-afd6-27e6d05e7102 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:31:53.948393 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_cell0:SELECT=2 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:31:53.951870 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-4563b814-41b1-471c-afd6-27e6d05e7102 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:31:53.954041 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-4563b814-41b1-471c-afd6-27e6d05e7102 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1407 microversion: 2.20 time: 0.339310 May 19 13:31:53.955762 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 37/89] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:31:53 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1407 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 13:31:53.978777 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-b9c50b53-00f7-4f08-bcee-4477516b9910 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:31:53.997918 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-6df78f92-a5dc-4391-b78e-55e62c8b8b57 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:31:53.999030 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-6df78f92-a5dc-4391-b78e-55e62c8b8b57 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] [instance: 080936a4-151d-4f4b-a750-937d342729db] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:31:54.000395 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-b9c50b53-00f7-4f08-bcee-4477516b9910 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a" status: 200 len: 1322 microversion: 2.1 time: 0.478502 May 19 13:31:54.013096 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 53/90] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:31:53 2022] GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a => generated 1322 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:31:54.020520 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-6df78f92-a5dc-4391-b78e-55e62c8b8b57 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:54.021011 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-6df78f92-a5dc-4391-b78e-55e62c8b8b57 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:54.023315 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-6df78f92-a5dc-4391-b78e-55e62c8b8b57 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:54.023763 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-6df78f92-a5dc-4391-b78e-55e62c8b8b57 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:54.288006 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-6df78f92-a5dc-4391-b78e-55e62c8b8b57 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ceb5b9477e431ba4a01adf2f3f485a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b09e85301c4e349b6714b13ae2e955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:31:54.317300 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-6df78f92-a5dc-4391-b78e-55e62c8b8b57 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] 10.222.0.24 "GET /compute/v2.1/servers/080936a4-151d-4f4b-a750-937d342729db" status: 200 len: 1315 microversion: 2.1 time: 0.335173 May 19 13:31:54.319684 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 38/91] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:31:53 2022] GET /compute/v2.1/servers/080936a4-151d-4f4b-a750-937d342729db => generated 1315 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:31:54.972665 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-60e1db24-1984-4434-9ad3-e8adfdf50fe1 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:31:54.973466 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-60e1db24-1984-4434-9ad3-e8adfdf50fe1 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:31:54.980810 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-60e1db24-1984-4434-9ad3-e8adfdf50fe1 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:54.981468 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-60e1db24-1984-4434-9ad3-e8adfdf50fe1 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:54.982296 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-60e1db24-1984-4434-9ad3-e8adfdf50fe1 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:54.982727 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-60e1db24-1984-4434-9ad3-e8adfdf50fe1 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:55.021271 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-dc029822-6321-446d-931f-36ae6e2edb5d tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:31:55.022909 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-dc029822-6321-446d-931f-36ae6e2edb5d tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: bb839e22-971b-4313-be06-20e09838215a] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:31:55.031597 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-dc029822-6321-446d-931f-36ae6e2edb5d tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:55.032059 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-dc029822-6321-446d-931f-36ae6e2edb5d tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:55.033607 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-dc029822-6321-446d-931f-36ae6e2edb5d tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:55.034291 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-dc029822-6321-446d-931f-36ae6e2edb5d tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:55.334415 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-dc029822-6321-446d-931f-36ae6e2edb5d tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:31:55.346057 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-dc029822-6321-446d-931f-36ae6e2edb5d tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a" status: 200 len: 1322 microversion: 2.1 time: 0.329287 May 19 13:31:55.347042 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 39/92] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:31:55 2022] GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a => generated 1322 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:31:55.357840 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-190f2267-a31c-4ab8-adfc-b79aa797b3bc tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:31:55.366487 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-190f2267-a31c-4ab8-adfc-b79aa797b3bc tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] [instance: 080936a4-151d-4f4b-a750-937d342729db] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:31:55.375146 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-190f2267-a31c-4ab8-adfc-b79aa797b3bc tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:55.375595 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-190f2267-a31c-4ab8-adfc-b79aa797b3bc tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:55.380216 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-190f2267-a31c-4ab8-adfc-b79aa797b3bc tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:55.380664 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-190f2267-a31c-4ab8-adfc-b79aa797b3bc tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:55.407654 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-60e1db24-1984-4434-9ad3-e8adfdf50fe1 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:31:55.421990 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-60e1db24-1984-4434-9ad3-e8adfdf50fe1 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:31:55.424565 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-60e1db24-1984-4434-9ad3-e8adfdf50fe1 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:31:55.447424 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-60e1db24-1984-4434-9ad3-e8adfdf50fe1 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1407 microversion: 2.20 time: 0.478131 May 19 13:31:55.450054 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 54/93] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:31:54 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1407 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:31:55.946318 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-190f2267-a31c-4ab8-adfc-b79aa797b3bc tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ceb5b9477e431ba4a01adf2f3f485a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b09e85301c4e349b6714b13ae2e955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:31:55.955892 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-190f2267-a31c-4ab8-adfc-b79aa797b3bc tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] 10.222.0.24 "GET /compute/v2.1/servers/080936a4-151d-4f4b-a750-937d342729db" status: 200 len: 1315 microversion: 2.1 time: 0.607060 May 19 13:31:55.973760 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 40/94] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:31:55 2022] GET /compute/v2.1/servers/080936a4-151d-4f4b-a750-937d342729db => generated 1315 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:31:56.060303 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [req-f639225f-72a4-4254-88f6-8f7bb3af83aa req-d6fbcdc7-d774-4e13-97e8-297a3658cdc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "323322ec-2e2e-424b-a411-8a34069bcf10", "name": "network-vif-plugged", "status": "completed", "tag": "1ae6b782-184e-4357-ab26-9a0648e0a6a3"}]} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:31:56.074405 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-f639225f-72a4-4254-88f6-8f7bb3af83aa req-d6fbcdc7-d774-4e13-97e8-297a3658cdc2 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:56.075569 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-f639225f-72a4-4254-88f6-8f7bb3af83aa req-d6fbcdc7-d774-4e13-97e8-297a3658cdc2 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:56.093371 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.compute.server_external_events [req-f639225f-72a4-4254-88f6-8f7bb3af83aa req-d6fbcdc7-d774-4e13-97e8-297a3658cdc2 service nova] Creating event network-vif-plugged:1ae6b782-184e-4357-ab26-9a0648e0a6a3 for instance 323322ec-2e2e-424b-a411-8a34069bcf10 on hv-cinder-84112 May 19 13:31:56.101645 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [req-f639225f-72a4-4254-88f6-8f7bb3af83aa req-d6fbcdc7-d774-4e13-97e8-297a3658cdc2 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043449 May 19 13:31:56.102658 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 55/95] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:31:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:31:56.364738 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-9fea4335-b7a0-4376-9a79-5d5e53042f07 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:31:56.365672 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-9fea4335-b7a0-4376-9a79-5d5e53042f07 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: bb839e22-971b-4313-be06-20e09838215a] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:31:56.380205 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-9fea4335-b7a0-4376-9a79-5d5e53042f07 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:56.380892 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-9fea4335-b7a0-4376-9a79-5d5e53042f07 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:56.381910 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-9fea4335-b7a0-4376-9a79-5d5e53042f07 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:56.382616 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-9fea4335-b7a0-4376-9a79-5d5e53042f07 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:56.478701 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-4f3cb5c1-e2a9-4800-8455-eaacb551731f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:31:56.479912 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-4f3cb5c1-e2a9-4800-8455-eaacb551731f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:31:56.497885 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-4f3cb5c1-e2a9-4800-8455-eaacb551731f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:56.498726 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-4f3cb5c1-e2a9-4800-8455-eaacb551731f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:56.501300 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-4f3cb5c1-e2a9-4800-8455-eaacb551731f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:56.502080 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-4f3cb5c1-e2a9-4800-8455-eaacb551731f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:56.734135 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-9fea4335-b7a0-4376-9a79-5d5e53042f07 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:31:56.746119 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-9fea4335-b7a0-4376-9a79-5d5e53042f07 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a" status: 200 len: 1322 microversion: 2.1 time: 0.385624 May 19 13:31:56.748532 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 41/96] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:31:56 2022] GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a => generated 1322 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:31:56.837587 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-4f3cb5c1-e2a9-4800-8455-eaacb551731f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:31:56.848191 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-4f3cb5c1-e2a9-4800-8455-eaacb551731f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:31:56.850441 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-4f3cb5c1-e2a9-4800-8455-eaacb551731f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:31:56.851998 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-4f3cb5c1-e2a9-4800-8455-eaacb551731f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1407 microversion: 2.20 time: 0.377709 May 19 13:31:56.853503 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 56/97] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:31:56 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1407 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:31:56.996819 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-7c6b74a1-fa21-4f87-825d-6ef526c7e2cc tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:31:56.997550 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-7c6b74a1-fa21-4f87-825d-6ef526c7e2cc tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] [instance: 080936a4-151d-4f4b-a750-937d342729db] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:31:57.010391 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-7c6b74a1-fa21-4f87-825d-6ef526c7e2cc tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:57.011203 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-7c6b74a1-fa21-4f87-825d-6ef526c7e2cc tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:57.012694 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-7c6b74a1-fa21-4f87-825d-6ef526c7e2cc tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:57.013276 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-7c6b74a1-fa21-4f87-825d-6ef526c7e2cc tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:57.324993 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-7c6b74a1-fa21-4f87-825d-6ef526c7e2cc tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ceb5b9477e431ba4a01adf2f3f485a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b09e85301c4e349b6714b13ae2e955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:31:57.333617 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-7c6b74a1-fa21-4f87-825d-6ef526c7e2cc tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] 10.222.0.24 "GET /compute/v2.1/servers/080936a4-151d-4f4b-a750-937d342729db" status: 200 len: 1501 microversion: 2.1 time: 0.347296 May 19 13:31:57.346047 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 42/98] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:31:56 2022] GET /compute/v2.1/servers/080936a4-151d-4f4b-a750-937d342729db => generated 1501 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:31:57.765174 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-60b1ad42-d4db-4c6a-942b-37a3a8a5ed0d tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:31:57.769813 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-60b1ad42-d4db-4c6a-942b-37a3a8a5ed0d tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: bb839e22-971b-4313-be06-20e09838215a] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:31:57.784055 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-60b1ad42-d4db-4c6a-942b-37a3a8a5ed0d tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:57.784565 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-60b1ad42-d4db-4c6a-942b-37a3a8a5ed0d tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:57.785397 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-60b1ad42-d4db-4c6a-942b-37a3a8a5ed0d tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:57.786428 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-60b1ad42-d4db-4c6a-942b-37a3a8a5ed0d tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:57.870883 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-a53c99e4-73c9-4f8f-88d8-43030681923e tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:31:57.871471 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-a53c99e4-73c9-4f8f-88d8-43030681923e tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:31:57.878553 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-a53c99e4-73c9-4f8f-88d8-43030681923e tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:57.879549 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-a53c99e4-73c9-4f8f-88d8-43030681923e tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:57.880335 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-a53c99e4-73c9-4f8f-88d8-43030681923e tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:57.880771 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-a53c99e4-73c9-4f8f-88d8-43030681923e tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:57.956612 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-60b1ad42-d4db-4c6a-942b-37a3a8a5ed0d tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:31:57.968843 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-60b1ad42-d4db-4c6a-942b-37a3a8a5ed0d tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a" status: 200 len: 1322 microversion: 2.1 time: 0.207479 May 19 13:31:57.978645 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 57/99] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:31:57 2022] GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a => generated 1322 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:31:58.035580 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-a53c99e4-73c9-4f8f-88d8-43030681923e tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:31:58.046036 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-a53c99e4-73c9-4f8f-88d8-43030681923e tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:31:58.048536 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-a53c99e4-73c9-4f8f-88d8-43030681923e tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:31:58.050047 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-a53c99e4-73c9-4f8f-88d8-43030681923e tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1407 microversion: 2.20 time: 0.183119 May 19 13:31:58.062088 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 43/100] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:31:57 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1407 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:31:58.986861 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-2f7a2950-cfa9-4e6b-87b1-192c38ee44cc tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:31:58.988104 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-2f7a2950-cfa9-4e6b-87b1-192c38ee44cc tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: bb839e22-971b-4313-be06-20e09838215a] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:31:58.995114 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-2f7a2950-cfa9-4e6b-87b1-192c38ee44cc tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:58.996035 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-2f7a2950-cfa9-4e6b-87b1-192c38ee44cc tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:58.996963 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-2f7a2950-cfa9-4e6b-87b1-192c38ee44cc tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:58.997744 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-2f7a2950-cfa9-4e6b-87b1-192c38ee44cc tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:59.068155 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-5a5aaa84-6781-407e-a3a0-06588d4f5a73 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:31:59.068758 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-5a5aaa84-6781-407e-a3a0-06588d4f5a73 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:31:59.077535 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-5a5aaa84-6781-407e-a3a0-06588d4f5a73 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:59.078335 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-5a5aaa84-6781-407e-a3a0-06588d4f5a73 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:59.079646 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-5a5aaa84-6781-407e-a3a0-06588d4f5a73 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:31:59.080337 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-5a5aaa84-6781-407e-a3a0-06588d4f5a73 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:31:59.172610 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-2f7a2950-cfa9-4e6b-87b1-192c38ee44cc tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:31:59.184271 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-2f7a2950-cfa9-4e6b-87b1-192c38ee44cc tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a" status: 200 len: 1322 microversion: 2.1 time: 0.201047 May 19 13:31:59.194170 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 58/101] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:31:58 2022] GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a => generated 1322 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:31:59.287158 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-5a5aaa84-6781-407e-a3a0-06588d4f5a73 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:31:59.300696 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-5a5aaa84-6781-407e-a3a0-06588d4f5a73 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:31:59.303011 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-5a5aaa84-6781-407e-a3a0-06588d4f5a73 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:31:59.304476 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-5a5aaa84-6781-407e-a3a0-06588d4f5a73 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1407 microversion: 2.20 time: 0.240171 May 19 13:31:59.306102 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 44/102] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:31:59 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1407 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 13:32:00.201714 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-616a71fb-5f1b-4d6b-96bf-87e41718aa1d tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:00.202877 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-616a71fb-5f1b-4d6b-96bf-87e41718aa1d tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: bb839e22-971b-4313-be06-20e09838215a] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:00.209720 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-616a71fb-5f1b-4d6b-96bf-87e41718aa1d tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:00.210358 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-616a71fb-5f1b-4d6b-96bf-87e41718aa1d tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:00.211298 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-616a71fb-5f1b-4d6b-96bf-87e41718aa1d tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:00.211885 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-616a71fb-5f1b-4d6b-96bf-87e41718aa1d tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:00.323134 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-42839f25-49d7-4add-88bf-49bf3863abd5 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:00.323818 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-42839f25-49d7-4add-88bf-49bf3863abd5 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:00.325916 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_cell0:SELECT=2 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:32:00.331796 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-42839f25-49d7-4add-88bf-49bf3863abd5 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:00.334235 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-42839f25-49d7-4add-88bf-49bf3863abd5 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:00.337955 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-42839f25-49d7-4add-88bf-49bf3863abd5 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:00.339001 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-42839f25-49d7-4add-88bf-49bf3863abd5 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:00.381500 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-616a71fb-5f1b-4d6b-96bf-87e41718aa1d tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:00.393824 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-616a71fb-5f1b-4d6b-96bf-87e41718aa1d tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a" status: 200 len: 1322 microversion: 2.1 time: 0.196187 May 19 13:32:00.394534 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 59/103] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:00 2022] GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a => generated 1322 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:32:00.520004 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-42839f25-49d7-4add-88bf-49bf3863abd5 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:00.528180 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-42839f25-49d7-4add-88bf-49bf3863abd5 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:00.541993 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-42839f25-49d7-4add-88bf-49bf3863abd5 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:00.545450 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-42839f25-49d7-4add-88bf-49bf3863abd5 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1407 microversion: 2.20 time: 0.225916 May 19 13:32:00.546214 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 45/104] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:32:00 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1407 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:32:01.041699 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [req-682af1ff-04dd-456a-9cb4-2adf877dd288 req-42223727-2494-4fff-a029-fe328b687b92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb839e22-971b-4313-be06-20e09838215a", "name": "network-vif-plugged", "status": "completed", "tag": "ea2cc4f1-cac0-4395-b583-23d210e4ca9b"}]} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:32:01.064260 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-682af1ff-04dd-456a-9cb4-2adf877dd288 req-42223727-2494-4fff-a029-fe328b687b92 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:01.064900 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-682af1ff-04dd-456a-9cb4-2adf877dd288 req-42223727-2494-4fff-a029-fe328b687b92 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:01.079392 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.compute.server_external_events [req-682af1ff-04dd-456a-9cb4-2adf877dd288 req-42223727-2494-4fff-a029-fe328b687b92 service nova] Creating event network-vif-plugged:ea2cc4f1-cac0-4395-b583-23d210e4ca9b for instance bb839e22-971b-4313-be06-20e09838215a on hv-cinder-84112 May 19 13:32:01.085729 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [req-682af1ff-04dd-456a-9cb4-2adf877dd288 req-42223727-2494-4fff-a029-fe328b687b92 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048340 May 19 13:32:01.086792 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 60/105] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:32:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:32:01.157292 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-c618d272-15b7-49f4-b8e4-5b2301bd5b22 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eb3c14d5-e133-45ec-ad59-5d144bfd1be6"}} {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:32:01.158977 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-c618d272-15b7-49f4-b8e4-5b2301bd5b22 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] [instance: 080936a4-151d-4f4b-a750-937d342729db] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:01.195278 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-c618d272-15b7-49f4-b8e4-5b2301bd5b22 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:01.201858 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-c618d272-15b7-49f4-b8e4-5b2301bd5b22 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:01.203707 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-c618d272-15b7-49f4-b8e4-5b2301bd5b22 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:01.204156 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-c618d272-15b7-49f4-b8e4-5b2301bd5b22 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:01.412059 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-f7eeeaac-376f-4ed6-865b-0e4b5a5c6c41 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:01.414520 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-f7eeeaac-376f-4ed6-865b-0e4b5a5c6c41 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: bb839e22-971b-4313-be06-20e09838215a] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:01.426437 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-f7eeeaac-376f-4ed6-865b-0e4b5a5c6c41 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:01.428133 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-f7eeeaac-376f-4ed6-865b-0e4b5a5c6c41 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:01.429304 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-f7eeeaac-376f-4ed6-865b-0e4b5a5c6c41 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:01.429743 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-f7eeeaac-376f-4ed6-865b-0e4b5a5c6c41 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:01.690578 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-f7eeeaac-376f-4ed6-865b-0e4b5a5c6c41 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:01.707412 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-f7eeeaac-376f-4ed6-865b-0e4b5a5c6c41 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a" status: 200 len: 1322 microversion: 2.1 time: 0.296735 May 19 13:32:01.708041 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 61/106] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:01 2022] GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a => generated 1322 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:32:01.720219 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-fc01e45d-ea89-4d0d-a08d-3ab85f85c739 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:01.720878 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-fc01e45d-ea89-4d0d-a08d-3ab85f85c739 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:01.727034 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-fc01e45d-ea89-4d0d-a08d-3ab85f85c739 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:01.727730 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-fc01e45d-ea89-4d0d-a08d-3ab85f85c739 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:01.728835 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-fc01e45d-ea89-4d0d-a08d-3ab85f85c739 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:01.729430 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-fc01e45d-ea89-4d0d-a08d-3ab85f85c739 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:01.900410 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-fc01e45d-ea89-4d0d-a08d-3ab85f85c739 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:01.910365 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-fc01e45d-ea89-4d0d-a08d-3ab85f85c739 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:01.919577 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-fc01e45d-ea89-4d0d-a08d-3ab85f85c739 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:01.921646 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-fc01e45d-ea89-4d0d-a08d-3ab85f85c739 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1599 microversion: 2.20 time: 0.212278 May 19 13:32:01.922215 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 62/107] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:32:01 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1599 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:32:01.940932 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-2274777a-6f8d-473d-93e8-53a51b7b8b5e tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:01.941559 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-2274777a-6f8d-473d-93e8-53a51b7b8b5e tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:01.948773 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-2274777a-6f8d-473d-93e8-53a51b7b8b5e tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:01.949216 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-2274777a-6f8d-473d-93e8-53a51b7b8b5e tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:01.950024 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-2274777a-6f8d-473d-93e8-53a51b7b8b5e tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:01.950453 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-2274777a-6f8d-473d-93e8-53a51b7b8b5e tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:02.088367 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-2274777a-6f8d-473d-93e8-53a51b7b8b5e tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.151173 May 19 13:32:02.095240 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 63/108] 10.222.0.24 () {60 vars in 1315 bytes} [Thu May 19 13:32:01 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10/os-interface => generated 284 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 13:32:02.403452 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-c618d272-15b7-49f4-b8e4-5b2301bd5b22 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] 10.222.0.24 "POST /compute/v2.1/servers/080936a4-151d-4f4b-a750-937d342729db/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.251177 May 19 13:32:02.404117 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 46/109] 10.222.0.24 () {60 vars in 1322 bytes} [Thu May 19 13:32:01 2022] POST /compute/v2.1/servers/080936a4-151d-4f4b-a750-937d342729db/os-volume_attachments => generated 194 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:32:02.727280 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-6038653e-2e36-47bb-be12-5c95f06bd472 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:02.729793 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-6038653e-2e36-47bb-be12-5c95f06bd472 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: bb839e22-971b-4313-be06-20e09838215a] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:02.736472 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-6038653e-2e36-47bb-be12-5c95f06bd472 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:02.736908 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-6038653e-2e36-47bb-be12-5c95f06bd472 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:02.737910 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-6038653e-2e36-47bb-be12-5c95f06bd472 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:02.738535 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-6038653e-2e36-47bb-be12-5c95f06bd472 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:03.126170 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [req-1750dc9b-8467-4a32-8281-352dda31921b req-e2b2afe5-ec4e-4607-a2a5-6ac1a226ca2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4c1abc9-8651-4788-9650-27704ae7e306", "name": "network-vif-plugged", "status": "completed", "tag": "700b033c-2fd5-4b02-a577-7fa27ba29508"}]} {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:32:03.135601 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [req-1750dc9b-8467-4a32-8281-352dda31921b req-e2b2afe5-ec4e-4607-a2a5-6ac1a226ca2b service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:03.136037 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [req-1750dc9b-8467-4a32-8281-352dda31921b req-e2b2afe5-ec4e-4607-a2a5-6ac1a226ca2b service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:03.147565 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.compute.server_external_events [req-1750dc9b-8467-4a32-8281-352dda31921b req-e2b2afe5-ec4e-4607-a2a5-6ac1a226ca2b service nova] Creating event network-vif-plugged:700b033c-2fd5-4b02-a577-7fa27ba29508 for instance c4c1abc9-8651-4788-9650-27704ae7e306 on hv-cinder-84112 May 19 13:32:03.152408 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [req-1750dc9b-8467-4a32-8281-352dda31921b req-e2b2afe5-ec4e-4607-a2a5-6ac1a226ca2b service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030857 May 19 13:32:03.153009 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 47/110] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:32:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 13:32:03.224985 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-6038653e-2e36-47bb-be12-5c95f06bd472 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:03.235589 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-6038653e-2e36-47bb-be12-5c95f06bd472 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a" status: 200 len: 1516 microversion: 2.1 time: 0.513527 May 19 13:32:03.236135 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 64/111] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:02 2022] GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a => generated 1516 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:32:03.262292 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-882da858-6c22-4f1e-a26a-a7635e0913fa tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:32:03.263775 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-882da858-6c22-4f1e-a26a-a7635e0913fa tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: bb839e22-971b-4313-be06-20e09838215a] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:03.278485 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-882da858-6c22-4f1e-a26a-a7635e0913fa tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:03.281584 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-882da858-6c22-4f1e-a26a-a7635e0913fa tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:03.282618 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-882da858-6c22-4f1e-a26a-a7635e0913fa tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:03.283202 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-882da858-6c22-4f1e-a26a-a7635e0913fa tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:03.292253 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:32:03.333122 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.objects.instance [None req-882da858-6c22-4f1e-a26a-a7635e0913fa tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lazy-loading 'flavor' on Instance uuid bb839e22-971b-4313-be06-20e09838215a {{(pid=120472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 13:32:03.652151 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-882da858-6c22-4f1e-a26a-a7635e0913fa tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "POST /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a/action" status: 200 len: 32 microversion: 2.1 time: 0.400062 May 19 13:32:03.665801 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-a334c60b-b18e-4416-ac5d-38e152ddeac9 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:03.666778 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-a334c60b-b18e-4416-ac5d-38e152ddeac9 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: bb839e22-971b-4313-be06-20e09838215a] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:03.672500 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 48/112] 10.222.0.24 () {60 vars in 1277 bytes} [Thu May 19 13:32:03 2022] POST /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a/action => generated 32 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 13:32:03.677314 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-a334c60b-b18e-4416-ac5d-38e152ddeac9 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:03.678051 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-a334c60b-b18e-4416-ac5d-38e152ddeac9 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:03.679923 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-a334c60b-b18e-4416-ac5d-38e152ddeac9 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:03.680522 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-a334c60b-b18e-4416-ac5d-38e152ddeac9 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:03.931302 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-a334c60b-b18e-4416-ac5d-38e152ddeac9 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:03.940341 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-a334c60b-b18e-4416-ac5d-38e152ddeac9 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a" status: 200 len: 1522 microversion: 2.1 time: 0.278706 May 19 13:32:03.941344 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 65/113] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:03 2022] GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a => generated 1522 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:32:04.134775 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [req-43093625-b490-4f07-bae4-a4d7741e86b5 req-d5b7ad86-7a3e-4b2a-b0ca-3b05547f70a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "323322ec-2e2e-424b-a411-8a34069bcf10", "tag": "1ae6b782-184e-4357-ab26-9a0648e0a6a3"}]} {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:32:04.144784 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [req-43093625-b490-4f07-bae4-a4d7741e86b5 req-d5b7ad86-7a3e-4b2a-b0ca-3b05547f70a5 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:04.145458 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [req-43093625-b490-4f07-bae4-a4d7741e86b5 req-d5b7ad86-7a3e-4b2a-b0ca-3b05547f70a5 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:04.157900 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.compute.server_external_events [req-43093625-b490-4f07-bae4-a4d7741e86b5 req-d5b7ad86-7a3e-4b2a-b0ca-3b05547f70a5 service nova] Creating event network-changed:1ae6b782-184e-4357-ab26-9a0648e0a6a3 for instance 323322ec-2e2e-424b-a411-8a34069bcf10 on hv-cinder-84112 May 19 13:32:04.163503 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [req-43093625-b490-4f07-bae4-a4d7741e86b5 req-d5b7ad86-7a3e-4b2a-b0ca-3b05547f70a5 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032809 May 19 13:32:04.164596 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 49/114] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:32:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:32:04.957745 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-169b9931-6b79-4365-8665-8d00d7bb3d13 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:04.958354 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-169b9931-6b79-4365-8665-8d00d7bb3d13 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: bb839e22-971b-4313-be06-20e09838215a] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:04.965401 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-169b9931-6b79-4365-8665-8d00d7bb3d13 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:04.965883 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-169b9931-6b79-4365-8665-8d00d7bb3d13 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:04.966887 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-169b9931-6b79-4365-8665-8d00d7bb3d13 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:04.967326 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-169b9931-6b79-4365-8665-8d00d7bb3d13 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:05.117771 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-169b9931-6b79-4365-8665-8d00d7bb3d13 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:05.125776 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-169b9931-6b79-4365-8665-8d00d7bb3d13 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a" status: 200 len: 1522 microversion: 2.1 time: 0.171862 May 19 13:32:05.130121 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 66/115] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:04 2022] GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:32:06.144938 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-c82b8e63-4afc-42ac-8910-c684bc3340e0 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:06.145540 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-c82b8e63-4afc-42ac-8910-c684bc3340e0 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: bb839e22-971b-4313-be06-20e09838215a] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:06.152702 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-c82b8e63-4afc-42ac-8910-c684bc3340e0 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:06.153153 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-c82b8e63-4afc-42ac-8910-c684bc3340e0 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:06.154023 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-c82b8e63-4afc-42ac-8910-c684bc3340e0 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:06.154447 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-c82b8e63-4afc-42ac-8910-c684bc3340e0 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:06.292744 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-c82b8e63-4afc-42ac-8910-c684bc3340e0 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:06.304244 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-c82b8e63-4afc-42ac-8910-c684bc3340e0 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a" status: 200 len: 1522 microversion: 2.1 time: 0.164191 May 19 13:32:06.304829 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 50/116] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:06 2022] GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:32:07.321338 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-226bddd5-31aa-4c5c-aac9-0e7dcb3c60e2 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:07.321980 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-226bddd5-31aa-4c5c-aac9-0e7dcb3c60e2 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: bb839e22-971b-4313-be06-20e09838215a] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:07.328311 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-226bddd5-31aa-4c5c-aac9-0e7dcb3c60e2 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:07.328752 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-226bddd5-31aa-4c5c-aac9-0e7dcb3c60e2 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:07.329549 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-226bddd5-31aa-4c5c-aac9-0e7dcb3c60e2 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:07.329982 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-226bddd5-31aa-4c5c-aac9-0e7dcb3c60e2 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:07.471370 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-226bddd5-31aa-4c5c-aac9-0e7dcb3c60e2 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:07.480373 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-226bddd5-31aa-4c5c-aac9-0e7dcb3c60e2 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a" status: 200 len: 1522 microversion: 2.1 time: 0.162771 May 19 13:32:07.481026 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 67/117] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:07 2022] GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:32:08.496896 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-d71f2f29-df10-4ec5-bdf7-503a4f3af209 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:08.497605 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-d71f2f29-df10-4ec5-bdf7-503a4f3af209 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: bb839e22-971b-4313-be06-20e09838215a] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:08.504568 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-d71f2f29-df10-4ec5-bdf7-503a4f3af209 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:08.505010 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-d71f2f29-df10-4ec5-bdf7-503a4f3af209 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:08.505797 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-d71f2f29-df10-4ec5-bdf7-503a4f3af209 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:08.506285 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-d71f2f29-df10-4ec5-bdf7-503a4f3af209 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:08.716135 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-d71f2f29-df10-4ec5-bdf7-503a4f3af209 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:08.729970 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-d71f2f29-df10-4ec5-bdf7-503a4f3af209 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a" status: 200 len: 1522 microversion: 2.1 time: 0.236671 May 19 13:32:08.731339 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 51/118] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:08 2022] GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:32:09.752003 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-349bfc14-19af-4a48-aa55-752596ca308c tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:09.752704 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-349bfc14-19af-4a48-aa55-752596ca308c tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: bb839e22-971b-4313-be06-20e09838215a] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:09.759825 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-349bfc14-19af-4a48-aa55-752596ca308c tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:09.760199 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-349bfc14-19af-4a48-aa55-752596ca308c tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:09.761473 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-349bfc14-19af-4a48-aa55-752596ca308c tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:09.761473 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-349bfc14-19af-4a48-aa55-752596ca308c tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:09.803007 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_cell1:SELECT=100 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:32:10.152978 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-349bfc14-19af-4a48-aa55-752596ca308c tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:10.167035 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-349bfc14-19af-4a48-aa55-752596ca308c tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a" status: 200 len: 1522 microversion: 2.1 time: 0.417593 May 19 13:32:10.168375 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 68/119] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:09 2022] GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a => generated 1522 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:32:11.187680 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-299c2667-e760-437b-90cd-8cf92ac26488 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:11.189704 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-299c2667-e760-437b-90cd-8cf92ac26488 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: bb839e22-971b-4313-be06-20e09838215a] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:11.199851 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-299c2667-e760-437b-90cd-8cf92ac26488 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:11.200809 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-299c2667-e760-437b-90cd-8cf92ac26488 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:11.202402 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-299c2667-e760-437b-90cd-8cf92ac26488 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:11.203312 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-299c2667-e760-437b-90cd-8cf92ac26488 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:11.373030 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-299c2667-e760-437b-90cd-8cf92ac26488 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:11.384241 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-299c2667-e760-437b-90cd-8cf92ac26488 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a" status: 200 len: 1522 microversion: 2.1 time: 0.203712 May 19 13:32:11.386064 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 52/120] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:11 2022] GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:32:12.408459 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-9886b55c-0422-477c-bd8f-16e6f94a596b tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:12.409038 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-9886b55c-0422-477c-bd8f-16e6f94a596b tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: bb839e22-971b-4313-be06-20e09838215a] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:12.415722 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-9886b55c-0422-477c-bd8f-16e6f94a596b tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:12.416689 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-9886b55c-0422-477c-bd8f-16e6f94a596b tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:12.417734 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-9886b55c-0422-477c-bd8f-16e6f94a596b tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:12.418171 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-9886b55c-0422-477c-bd8f-16e6f94a596b tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:12.580823 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-9886b55c-0422-477c-bd8f-16e6f94a596b tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:12.588697 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-9886b55c-0422-477c-bd8f-16e6f94a596b tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a" status: 200 len: 1522 microversion: 2.1 time: 0.184229 May 19 13:32:12.589474 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 69/121] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:12 2022] GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:32:13.608018 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-342c5031-fc6b-4e44-847a-58fbae5d6de3 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:13.608565 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-342c5031-fc6b-4e44-847a-58fbae5d6de3 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: bb839e22-971b-4313-be06-20e09838215a] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:13.615462 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-342c5031-fc6b-4e44-847a-58fbae5d6de3 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:13.616011 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-342c5031-fc6b-4e44-847a-58fbae5d6de3 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:13.616824 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-342c5031-fc6b-4e44-847a-58fbae5d6de3 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:13.617264 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-342c5031-fc6b-4e44-847a-58fbae5d6de3 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:13.770099 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-342c5031-fc6b-4e44-847a-58fbae5d6de3 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:13.777903 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-342c5031-fc6b-4e44-847a-58fbae5d6de3 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a" status: 200 len: 1522 microversion: 2.1 time: 0.174138 May 19 13:32:13.778799 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 53/122] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:13 2022] GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:32:14.613145 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-2fd38dd4-7dbb-4cea-af28-a3ddcffcf637 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-128593470", "imageRef": "9beb860d-9c3f-4244-80aa-71a9c337a429", "flavorRef": "452"}} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:32:14.706855 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.network.neutron [None req-2fd38dd4-7dbb-4cea-af28-a3ddcffcf637 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] validate_networks() for None {{(pid=120471) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 13:32:14.795997 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-80974d1b-da30-4cd0-8426-5ba9c826e3e7 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:14.796813 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-80974d1b-da30-4cd0-8426-5ba9c826e3e7 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: bb839e22-971b-4313-be06-20e09838215a] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:14.805468 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-80974d1b-da30-4cd0-8426-5ba9c826e3e7 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:14.807126 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-80974d1b-da30-4cd0-8426-5ba9c826e3e7 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:14.810934 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-80974d1b-da30-4cd0-8426-5ba9c826e3e7 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:14.811553 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-80974d1b-da30-4cd0-8426-5ba9c826e3e7 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:15.021992 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-80974d1b-da30-4cd0-8426-5ba9c826e3e7 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:15.030579 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-80974d1b-da30-4cd0-8426-5ba9c826e3e7 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a" status: 200 len: 1522 microversion: 2.1 time: 0.238751 May 19 13:32:15.032633 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 54/123] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:14 2022] GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a => generated 1522 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:32:15.214626 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.virt.hardware [None req-2fd38dd4-7dbb-4cea-af28-a3ddcffcf637 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Flavor limits 0:0:0 {{(pid=120471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 13:32:15.215050 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.virt.hardware [None req-2fd38dd4-7dbb-4cea-af28-a3ddcffcf637 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Image limits 0:0:0 {{(pid=120471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 13:32:15.215515 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.virt.hardware [None req-2fd38dd4-7dbb-4cea-af28-a3ddcffcf637 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Flavor pref 0:0:0 {{(pid=120471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 13:32:15.215938 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.virt.hardware [None req-2fd38dd4-7dbb-4cea-af28-a3ddcffcf637 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Image pref 0:0:0 {{(pid=120471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 13:32:15.216454 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.virt.hardware [None req-2fd38dd4-7dbb-4cea-af28-a3ddcffcf637 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 13:32:15.233620 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-2fd38dd4-7dbb-4cea-af28-a3ddcffcf637 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:15.234038 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-2fd38dd4-7dbb-4cea-af28-a3ddcffcf637 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:15.234806 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-2fd38dd4-7dbb-4cea-af28-a3ddcffcf637 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:15.235407 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-2fd38dd4-7dbb-4cea-af28-a3ddcffcf637 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:15.281113 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.quota [None req-2fd38dd4-7dbb-4cea-af28-a3ddcffcf637 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Getting quotas for project 894127095d6445f5a2eafc9906ce5cf7. Resources: {'instances', 'cores', 'ram'} {{(pid=120471) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 13:32:15.288583 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.quota [None req-2fd38dd4-7dbb-4cea-af28-a3ddcffcf637 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Getting quotas for user fafefcbb62bf4284a8a9da5d6c0a4609 and project 894127095d6445f5a2eafc9906ce5cf7. Resources: {'instances', 'cores', 'ram'} {{(pid=120471) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 13:32:15.301321 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-2fd38dd4-7dbb-4cea-af28-a3ddcffcf637 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Going to run 1 instances... {{(pid=120471) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 13:32:15.304292 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-2fd38dd4-7dbb-4cea-af28-a3ddcffcf637 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] [instance: 718d3de9-c471-44df-8622-ce92537497bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9beb860d-9c3f-4244-80aa-71a9c337a429',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120471) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 13:32:15.383036 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-2fd38dd4-7dbb-4cea-af28-a3ddcffcf637 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.773828 May 19 13:32:15.389449 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 70/124] 10.222.0.24 () {60 vars in 1146 bytes} [Thu May 19 13:32:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 776 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 13:32:15.397748 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-a28b058b-4bf1-4028-9fff-e24eb8e2899e tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:15.398509 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-a28b058b-4bf1-4028-9fff-e24eb8e2899e tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] [instance: 718d3de9-c471-44df-8622-ce92537497bf] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:15.478337 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-a28b058b-4bf1-4028-9fff-e24eb8e2899e tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fafefcbb62bf4284a8a9da5d6c0a4609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894127095d6445f5a2eafc9906ce5cf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:15.486525 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-a28b058b-4bf1-4028-9fff-e24eb8e2899e tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] 10.222.0.24 "GET /compute/v2.1/servers/718d3de9-c471-44df-8622-ce92537497bf" status: 200 len: 1214 microversion: 2.1 time: 0.091737 May 19 13:32:15.487282 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 55/125] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:15 2022] GET /compute/v2.1/servers/718d3de9-c471-44df-8622-ce92537497bf => generated 1214 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:32:16.055515 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-1e9fd649-a5e9-488e-acf0-d84e42741c5b tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:16.057483 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-1e9fd649-a5e9-488e-acf0-d84e42741c5b tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: bb839e22-971b-4313-be06-20e09838215a] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:16.073444 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-1e9fd649-a5e9-488e-acf0-d84e42741c5b tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:16.074034 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-1e9fd649-a5e9-488e-acf0-d84e42741c5b tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:16.075084 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-1e9fd649-a5e9-488e-acf0-d84e42741c5b tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:16.076059 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-1e9fd649-a5e9-488e-acf0-d84e42741c5b tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:16.342523 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-1e9fd649-a5e9-488e-acf0-d84e42741c5b tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:16.352750 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-1e9fd649-a5e9-488e-acf0-d84e42741c5b tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a" status: 200 len: 1522 microversion: 2.1 time: 0.304189 May 19 13:32:16.363084 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 71/126] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:16 2022] GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a => generated 1522 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:32:16.504382 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-7509bd9a-cee1-497c-9da8-28efd8c91659 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:16.505639 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-7509bd9a-cee1-497c-9da8-28efd8c91659 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] [instance: 718d3de9-c471-44df-8622-ce92537497bf] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:16.513984 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-7509bd9a-cee1-497c-9da8-28efd8c91659 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:16.514790 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-7509bd9a-cee1-497c-9da8-28efd8c91659 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:16.515727 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-7509bd9a-cee1-497c-9da8-28efd8c91659 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:16.516302 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-7509bd9a-cee1-497c-9da8-28efd8c91659 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:16.634195 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-7509bd9a-cee1-497c-9da8-28efd8c91659 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fafefcbb62bf4284a8a9da5d6c0a4609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894127095d6445f5a2eafc9906ce5cf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:16.653559 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-7509bd9a-cee1-497c-9da8-28efd8c91659 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] 10.222.0.24 "GET /compute/v2.1/servers/718d3de9-c471-44df-8622-ce92537497bf" status: 200 len: 1266 microversion: 2.1 time: 0.148183 May 19 13:32:16.654319 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 56/127] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:16 2022] GET /compute/v2.1/servers/718d3de9-c471-44df-8622-ce92537497bf => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:32:16.706462 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-d85d23a6-bcf5-4555-bada-e414209e8dcb tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:16.707758 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-d85d23a6-bcf5-4555-bada-e414209e8dcb tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] [instance: 080936a4-151d-4f4b-a750-937d342729db] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:16.716084 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-d85d23a6-bcf5-4555-bada-e414209e8dcb tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:16.716084 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-d85d23a6-bcf5-4555-bada-e414209e8dcb tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:16.717308 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-d85d23a6-bcf5-4555-bada-e414209e8dcb tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:16.718048 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-d85d23a6-bcf5-4555-bada-e414209e8dcb tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:16.751121 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-d85d23a6-bcf5-4555-bada-e414209e8dcb tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] [instance: 080936a4-151d-4f4b-a750-937d342729db] Going to try to terminate instance {{(pid=120471) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 13:32:16.863139 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-d85d23a6-bcf5-4555-bada-e414209e8dcb tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] 10.222.0.24 "DELETE /compute/v2.1/servers/080936a4-151d-4f4b-a750-937d342729db" status: 204 len: 0 microversion: 2.1 time: 0.164171 May 19 13:32:16.866071 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 72/128] 10.222.0.24 () {58 vars in 1238 bytes} [Thu May 19 13:32:16 2022] DELETE /compute/v2.1/servers/080936a4-151d-4f4b-a750-937d342729db => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 13:32:16.874725 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-b764e48d-8aa8-4f84-9720-408486281b26 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:16.875733 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-b764e48d-8aa8-4f84-9720-408486281b26 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] [instance: 080936a4-151d-4f4b-a750-937d342729db] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:16.885018 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-b764e48d-8aa8-4f84-9720-408486281b26 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:16.889376 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-b764e48d-8aa8-4f84-9720-408486281b26 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:16.890774 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-b764e48d-8aa8-4f84-9720-408486281b26 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:16.891461 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-b764e48d-8aa8-4f84-9720-408486281b26 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:17.068067 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-b764e48d-8aa8-4f84-9720-408486281b26 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ceb5b9477e431ba4a01adf2f3f485a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b09e85301c4e349b6714b13ae2e955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:17.079054 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-b764e48d-8aa8-4f84-9720-408486281b26 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] 10.222.0.24 "GET /compute/v2.1/servers/080936a4-151d-4f4b-a750-937d342729db" status: 200 len: 1553 microversion: 2.1 time: 0.208919 May 19 13:32:17.079991 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 57/129] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:16 2022] GET /compute/v2.1/servers/080936a4-151d-4f4b-a750-937d342729db => generated 1553 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:32:17.370151 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-2e39be3e-847c-4c09-b760-ef910af301fc tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:17.370848 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-2e39be3e-847c-4c09-b760-ef910af301fc tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: bb839e22-971b-4313-be06-20e09838215a] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:17.378194 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-2e39be3e-847c-4c09-b760-ef910af301fc tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:17.378862 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-2e39be3e-847c-4c09-b760-ef910af301fc tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:17.379645 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-2e39be3e-847c-4c09-b760-ef910af301fc tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:17.380067 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-2e39be3e-847c-4c09-b760-ef910af301fc tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:17.519145 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-2e39be3e-847c-4c09-b760-ef910af301fc tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:17.527966 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-2e39be3e-847c-4c09-b760-ef910af301fc tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a" status: 200 len: 1522 microversion: 2.1 time: 0.162092 May 19 13:32:17.537682 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 73/130] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:17 2022] GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:32:17.671267 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-c09b1d86-b8e0-44d5-a880-05280bf6bede tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:17.671849 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-c09b1d86-b8e0-44d5-a880-05280bf6bede tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] [instance: 718d3de9-c471-44df-8622-ce92537497bf] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:17.674406 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_api:SELECT=57 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:32:17.681308 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-c09b1d86-b8e0-44d5-a880-05280bf6bede tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:17.681786 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-c09b1d86-b8e0-44d5-a880-05280bf6bede tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:17.682552 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-c09b1d86-b8e0-44d5-a880-05280bf6bede tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:17.682984 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-c09b1d86-b8e0-44d5-a880-05280bf6bede tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:17.752480 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-c09b1d86-b8e0-44d5-a880-05280bf6bede tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fafefcbb62bf4284a8a9da5d6c0a4609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894127095d6445f5a2eafc9906ce5cf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:17.762197 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-c09b1d86-b8e0-44d5-a880-05280bf6bede tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] 10.222.0.24 "GET /compute/v2.1/servers/718d3de9-c471-44df-8622-ce92537497bf" status: 200 len: 1284 microversion: 2.1 time: 0.094831 May 19 13:32:17.763817 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 58/131] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:17 2022] GET /compute/v2.1/servers/718d3de9-c471-44df-8622-ce92537497bf => generated 1284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:32:18.096939 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-be73f8c9-e6b3-4131-b7b0-6ca9daad0d08 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:18.097660 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-be73f8c9-e6b3-4131-b7b0-6ca9daad0d08 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] [instance: 080936a4-151d-4f4b-a750-937d342729db] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:18.106530 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-be73f8c9-e6b3-4131-b7b0-6ca9daad0d08 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:18.107707 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-be73f8c9-e6b3-4131-b7b0-6ca9daad0d08 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:18.108874 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-be73f8c9-e6b3-4131-b7b0-6ca9daad0d08 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:18.109525 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-be73f8c9-e6b3-4131-b7b0-6ca9daad0d08 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:18.288048 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-be73f8c9-e6b3-4131-b7b0-6ca9daad0d08 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ceb5b9477e431ba4a01adf2f3f485a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b09e85301c4e349b6714b13ae2e955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:18.299103 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-be73f8c9-e6b3-4131-b7b0-6ca9daad0d08 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] 10.222.0.24 "GET /compute/v2.1/servers/080936a4-151d-4f4b-a750-937d342729db" status: 200 len: 1553 microversion: 2.1 time: 0.206191 May 19 13:32:18.299799 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 74/132] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:18 2022] GET /compute/v2.1/servers/080936a4-151d-4f4b-a750-937d342729db => generated 1553 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:32:18.545592 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-648536f4-4763-4775-8278-f8b6185453f0 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:18.546198 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-648536f4-4763-4775-8278-f8b6185453f0 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: bb839e22-971b-4313-be06-20e09838215a] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:18.552226 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-648536f4-4763-4775-8278-f8b6185453f0 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:18.552682 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-648536f4-4763-4775-8278-f8b6185453f0 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:18.554761 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-648536f4-4763-4775-8278-f8b6185453f0 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:18.555419 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-648536f4-4763-4775-8278-f8b6185453f0 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:18.790159 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-46d6610c-b116-4137-beb7-469602d2cc5e tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:18.790761 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-46d6610c-b116-4137-beb7-469602d2cc5e tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] [instance: 718d3de9-c471-44df-8622-ce92537497bf] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:18.801329 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-46d6610c-b116-4137-beb7-469602d2cc5e tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:18.805702 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-46d6610c-b116-4137-beb7-469602d2cc5e tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:18.807023 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-46d6610c-b116-4137-beb7-469602d2cc5e tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:18.807624 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-46d6610c-b116-4137-beb7-469602d2cc5e tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:18.974058 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-46d6610c-b116-4137-beb7-469602d2cc5e tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fafefcbb62bf4284a8a9da5d6c0a4609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894127095d6445f5a2eafc9906ce5cf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:18.980160 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-648536f4-4763-4775-8278-f8b6185453f0 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:18.983297 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-46d6610c-b116-4137-beb7-469602d2cc5e tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] 10.222.0.24 "GET /compute/v2.1/servers/718d3de9-c471-44df-8622-ce92537497bf" status: 200 len: 1284 microversion: 2.1 time: 0.197164 May 19 13:32:18.989448 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 75/133] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:18 2022] GET /compute/v2.1/servers/718d3de9-c471-44df-8622-ce92537497bf => generated 1284 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:32:18.989621 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-648536f4-4763-4775-8278-f8b6185453f0 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a" status: 200 len: 1522 microversion: 2.1 time: 0.448318 May 19 13:32:18.990188 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 59/134] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:18 2022] GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a => generated 1522 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:32:19.320268 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-1ad1569d-4fae-4869-b7ae-91039df0b1b4 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:19.322371 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-1ad1569d-4fae-4869-b7ae-91039df0b1b4 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] [instance: 080936a4-151d-4f4b-a750-937d342729db] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:19.330867 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:32:19.346487 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-1ad1569d-4fae-4869-b7ae-91039df0b1b4 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:19.348183 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-1ad1569d-4fae-4869-b7ae-91039df0b1b4 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:19.350082 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-1ad1569d-4fae-4869-b7ae-91039df0b1b4 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:19.353046 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-1ad1569d-4fae-4869-b7ae-91039df0b1b4 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:19.923172 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-1ad1569d-4fae-4869-b7ae-91039df0b1b4 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ceb5b9477e431ba4a01adf2f3f485a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b09e85301c4e349b6714b13ae2e955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:19.936163 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-1ad1569d-4fae-4869-b7ae-91039df0b1b4 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] 10.222.0.24 "GET /compute/v2.1/servers/080936a4-151d-4f4b-a750-937d342729db" status: 200 len: 1553 microversion: 2.1 time: 0.622438 May 19 13:32:19.936723 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 76/135] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:19 2022] GET /compute/v2.1/servers/080936a4-151d-4f4b-a750-937d342729db => generated 1553 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:32:20.002417 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-71f6ec21-3f77-477c-8788-b26797e170e0 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:20.003260 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-71f6ec21-3f77-477c-8788-b26797e170e0 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] [instance: 718d3de9-c471-44df-8622-ce92537497bf] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:20.006964 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-ccdb37cb-56a9-4efd-8691-a865fbb60a6d tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:20.007917 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-ccdb37cb-56a9-4efd-8691-a865fbb60a6d tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: bb839e22-971b-4313-be06-20e09838215a] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:20.019280 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-ccdb37cb-56a9-4efd-8691-a865fbb60a6d tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:20.021283 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-ccdb37cb-56a9-4efd-8691-a865fbb60a6d tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:20.024123 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-71f6ec21-3f77-477c-8788-b26797e170e0 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:20.024309 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-ccdb37cb-56a9-4efd-8691-a865fbb60a6d tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:20.025911 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-ccdb37cb-56a9-4efd-8691-a865fbb60a6d tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:20.026048 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-71f6ec21-3f77-477c-8788-b26797e170e0 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:20.027425 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-71f6ec21-3f77-477c-8788-b26797e170e0 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:20.033187 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-71f6ec21-3f77-477c-8788-b26797e170e0 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:20.279058 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-71f6ec21-3f77-477c-8788-b26797e170e0 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fafefcbb62bf4284a8a9da5d6c0a4609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894127095d6445f5a2eafc9906ce5cf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:20.291214 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-71f6ec21-3f77-477c-8788-b26797e170e0 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] 10.222.0.24 "GET /compute/v2.1/servers/718d3de9-c471-44df-8622-ce92537497bf" status: 200 len: 1272 microversion: 2.1 time: 0.293323 May 19 13:32:20.293598 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 60/136] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:19 2022] GET /compute/v2.1/servers/718d3de9-c471-44df-8622-ce92537497bf => generated 1272 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:32:20.343524 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-ccdb37cb-56a9-4efd-8691-a865fbb60a6d tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:20.355513 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-ccdb37cb-56a9-4efd-8691-a865fbb60a6d tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a" status: 200 len: 1522 microversion: 2.1 time: 0.352736 May 19 13:32:20.365832 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 77/137] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:20 2022] GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a => generated 1522 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:32:20.863983 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [req-2d24d09f-2b22-4654-b51a-4b70ce99f202 req-967918e4-a4fd-4234-a8a0-bc02b0ada337 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "080936a4-151d-4f4b-a750-937d342729db", "name": "network-vif-deleted", "tag": "fdf6572a-31e1-4e19-9111-37d73967c97d"}]} {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:32:20.877150 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [req-2d24d09f-2b22-4654-b51a-4b70ce99f202 req-967918e4-a4fd-4234-a8a0-bc02b0ada337 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:20.877894 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [req-2d24d09f-2b22-4654-b51a-4b70ce99f202 req-967918e4-a4fd-4234-a8a0-bc02b0ada337 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:20.907675 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.compute.server_external_events [req-2d24d09f-2b22-4654-b51a-4b70ce99f202 req-967918e4-a4fd-4234-a8a0-bc02b0ada337 service nova] Creating event network-vif-deleted:fdf6572a-31e1-4e19-9111-37d73967c97d for instance 080936a4-151d-4f4b-a750-937d342729db on hv-cinder-84112 May 19 13:32:20.919857 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [req-2d24d09f-2b22-4654-b51a-4b70ce99f202 req-967918e4-a4fd-4234-a8a0-bc02b0ada337 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059162 May 19 13:32:20.923845 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 61/138] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:32:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:32:20.957725 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-af31691e-62f6-47cb-8db3-8eeb84b60b82 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:20.959471 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-af31691e-62f6-47cb-8db3-8eeb84b60b82 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] [instance: 080936a4-151d-4f4b-a750-937d342729db] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:20.967996 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-af31691e-62f6-47cb-8db3-8eeb84b60b82 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:20.969113 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-af31691e-62f6-47cb-8db3-8eeb84b60b82 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:20.970357 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-af31691e-62f6-47cb-8db3-8eeb84b60b82 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:20.971270 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-af31691e-62f6-47cb-8db3-8eeb84b60b82 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:21.076015 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-af31691e-62f6-47cb-8db3-8eeb84b60b82 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ceb5b9477e431ba4a01adf2f3f485a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b09e85301c4e349b6714b13ae2e955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:21.089470 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-af31691e-62f6-47cb-8db3-8eeb84b60b82 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] 10.222.0.24 "GET /compute/v2.1/servers/080936a4-151d-4f4b-a750-937d342729db" status: 200 len: 1511 microversion: 2.1 time: 0.135101 May 19 13:32:21.091567 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 78/139] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:20 2022] GET /compute/v2.1/servers/080936a4-151d-4f4b-a750-937d342729db => generated 1511 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:32:21.314492 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-18a6cc6b-4a24-4939-bc5c-605c93d9e278 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:21.316334 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-18a6cc6b-4a24-4939-bc5c-605c93d9e278 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] [instance: 718d3de9-c471-44df-8622-ce92537497bf] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:21.325402 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-18a6cc6b-4a24-4939-bc5c-605c93d9e278 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:21.325924 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-18a6cc6b-4a24-4939-bc5c-605c93d9e278 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:21.326661 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-18a6cc6b-4a24-4939-bc5c-605c93d9e278 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:21.327359 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-18a6cc6b-4a24-4939-bc5c-605c93d9e278 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:21.374619 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-814daf5f-0406-43d9-82c4-28f30c3d8988 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:21.375920 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-814daf5f-0406-43d9-82c4-28f30c3d8988 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: bb839e22-971b-4313-be06-20e09838215a] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:21.399781 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-814daf5f-0406-43d9-82c4-28f30c3d8988 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:21.400240 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-814daf5f-0406-43d9-82c4-28f30c3d8988 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:21.406435 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-814daf5f-0406-43d9-82c4-28f30c3d8988 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:21.406906 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-814daf5f-0406-43d9-82c4-28f30c3d8988 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:21.631261 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-18a6cc6b-4a24-4939-bc5c-605c93d9e278 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fafefcbb62bf4284a8a9da5d6c0a4609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894127095d6445f5a2eafc9906ce5cf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:21.642714 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-18a6cc6b-4a24-4939-bc5c-605c93d9e278 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] 10.222.0.24 "GET /compute/v2.1/servers/718d3de9-c471-44df-8622-ce92537497bf" status: 200 len: 1314 microversion: 2.1 time: 0.336689 May 19 13:32:21.646239 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 62/140] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:21 2022] GET /compute/v2.1/servers/718d3de9-c471-44df-8622-ce92537497bf => generated 1314 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:32:21.762401 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-814daf5f-0406-43d9-82c4-28f30c3d8988 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:21.772813 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-814daf5f-0406-43d9-82c4-28f30c3d8988 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a" status: 200 len: 1522 microversion: 2.1 time: 0.403877 May 19 13:32:21.774585 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 79/141] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:21 2022] GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a => generated 1522 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:32:22.111097 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-73a9b87a-d10a-4a66-9019-34529af5da90 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:22.112774 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-73a9b87a-d10a-4a66-9019-34529af5da90 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] [instance: 080936a4-151d-4f4b-a750-937d342729db] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:22.122150 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-73a9b87a-d10a-4a66-9019-34529af5da90 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:22.123217 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-73a9b87a-d10a-4a66-9019-34529af5da90 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:22.127458 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-73a9b87a-d10a-4a66-9019-34529af5da90 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:22.128281 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-73a9b87a-d10a-4a66-9019-34529af5da90 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:22.190748 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-73a9b87a-d10a-4a66-9019-34529af5da90 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:22.191152 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-73a9b87a-d10a-4a66-9019-34529af5da90 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:22.191974 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.objects.instance [None req-73a9b87a-d10a-4a66-9019-34529af5da90 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lazy-loading 'fault' on Instance uuid 080936a4-151d-4f4b-a750-937d342729db {{(pid=120472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 13:32:22.301249 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-73a9b87a-d10a-4a66-9019-34529af5da90 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ceb5b9477e431ba4a01adf2f3f485a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b09e85301c4e349b6714b13ae2e955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:22.312905 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-73a9b87a-d10a-4a66-9019-34529af5da90 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] 10.222.0.24 "GET /compute/v2.1/servers/080936a4-151d-4f4b-a750-937d342729db" status: 200 len: 1351 microversion: 2.1 time: 0.206601 May 19 13:32:22.313510 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 63/142] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:22 2022] GET /compute/v2.1/servers/080936a4-151d-4f4b-a750-937d342729db => generated 1351 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:32:22.661569 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-19404cd0-ef74-403d-a6a3-a90b4314251b tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:22.662852 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-19404cd0-ef74-403d-a6a3-a90b4314251b tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] [instance: 718d3de9-c471-44df-8622-ce92537497bf] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:22.670408 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-19404cd0-ef74-403d-a6a3-a90b4314251b tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:22.671078 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-19404cd0-ef74-403d-a6a3-a90b4314251b tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:22.672126 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-19404cd0-ef74-403d-a6a3-a90b4314251b tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:22.672824 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-19404cd0-ef74-403d-a6a3-a90b4314251b tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:22.793233 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-4d8d57fa-54d1-4d32-947d-f6cfe37de9d4 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:22.795375 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-4d8d57fa-54d1-4d32-947d-f6cfe37de9d4 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: bb839e22-971b-4313-be06-20e09838215a] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:22.806201 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-4d8d57fa-54d1-4d32-947d-f6cfe37de9d4 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:22.807144 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-4d8d57fa-54d1-4d32-947d-f6cfe37de9d4 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:22.808258 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-4d8d57fa-54d1-4d32-947d-f6cfe37de9d4 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:22.808835 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-4d8d57fa-54d1-4d32-947d-f6cfe37de9d4 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:22.849314 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-19404cd0-ef74-403d-a6a3-a90b4314251b tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fafefcbb62bf4284a8a9da5d6c0a4609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894127095d6445f5a2eafc9906ce5cf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:22.860819 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-19404cd0-ef74-403d-a6a3-a90b4314251b tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] 10.222.0.24 "GET /compute/v2.1/servers/718d3de9-c471-44df-8622-ce92537497bf" status: 200 len: 1314 microversion: 2.1 time: 0.203867 May 19 13:32:22.861452 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 80/143] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:22 2022] GET /compute/v2.1/servers/718d3de9-c471-44df-8622-ce92537497bf => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:32:22.947313 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [req-2a75365c-2443-4cc2-a05a-59b65ace78f0 req-d7c34b1c-82b8-49eb-bf47-09f222d5008c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "718d3de9-c471-44df-8622-ce92537497bf", "tag": "dbe4a516-99f2-45f8-9ab5-3ed1503a5ea7"}]} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:32:22.961483 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-2a75365c-2443-4cc2-a05a-59b65ace78f0 req-d7c34b1c-82b8-49eb-bf47-09f222d5008c service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:22.963300 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-2a75365c-2443-4cc2-a05a-59b65ace78f0 req-d7c34b1c-82b8-49eb-bf47-09f222d5008c service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:22.998524 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.compute.server_external_events [req-2a75365c-2443-4cc2-a05a-59b65ace78f0 req-d7c34b1c-82b8-49eb-bf47-09f222d5008c service nova] Creating event network-changed:dbe4a516-99f2-45f8-9ab5-3ed1503a5ea7 for instance 718d3de9-c471-44df-8622-ce92537497bf on hv-cinder-84112 May 19 13:32:23.014241 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [req-2a75365c-2443-4cc2-a05a-59b65ace78f0 req-d7c34b1c-82b8-49eb-bf47-09f222d5008c service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070198 May 19 13:32:23.014874 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 81/144] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:32:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 13:32:23.142546 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-4d8d57fa-54d1-4d32-947d-f6cfe37de9d4 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:23.147103 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:32:23.154337 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-4d8d57fa-54d1-4d32-947d-f6cfe37de9d4 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a" status: 200 len: 1522 microversion: 2.1 time: 0.366430 May 19 13:32:23.155542 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 64/145] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:22 2022] GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a => generated 1522 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:32:23.331009 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-57119066-252b-4b55-a30d-03def3c64770 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:23.334306 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-57119066-252b-4b55-a30d-03def3c64770 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] [instance: 080936a4-151d-4f4b-a750-937d342729db] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:23.354959 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-57119066-252b-4b55-a30d-03def3c64770 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:23.357039 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-57119066-252b-4b55-a30d-03def3c64770 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:23.358373 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-57119066-252b-4b55-a30d-03def3c64770 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:23.359012 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-57119066-252b-4b55-a30d-03def3c64770 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:23.394525 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.wsgi [None req-57119066-252b-4b55-a30d-03def3c64770 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] HTTP exception thrown: Instance 080936a4-151d-4f4b-a750-937d342729db could not be found. May 19 13:32:23.415766 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-57119066-252b-4b55-a30d-03def3c64770 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Request method failure captured: May 19 13:32:23.415766 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: request: GET /compute/v2.1/servers/080936a4-151d-4f4b-a750-937d342729db HTTP/1.1 May 19 13:32:23.415766 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Accept: application/json May 19 13:32:23.415766 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Accept-Encoding: identity May 19 13:32:23.415766 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Connection: close May 19 13:32:23.415766 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Content-Length: 0 May 19 13:32:23.415766 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Content-Type: application/json May 19 13:32:23.415766 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Host: 10.222.0.24 May 19 13:32:23.415766 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Openstack-System-Scope: None May 19 13:32:23.415766 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: User-Agent: python-urllib3/1.26.9 May 19 13:32:23.415766 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Auth-Token: gAAAAABihkaoiA4aiQjQnbsyWz4lLVsG9xjv_u-TDf5D_dWBZVGUtY8jIJWM5CjHzTRZIPMcntYcq-a4Ew17uTC9FRGQN_yIX6sLGwGvlpOID1Vwb6sRYYcVZ5ddzvBNGeFn_dtkhD12qP36CTTU_xN3iLUIo4Sk9ihAmtzLyuo7ibxdoE0xDrI May 19 13:32:23.415766 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Domain-Id: None May 19 13:32:23.415766 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Domain-Name: None May 19 13:32:23.415766 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Identity-Status: Confirmed May 19 13:32:23.415766 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Is-Admin-Project: True May 19 13:32:23.415766 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Domain-Id: default May 19 13:32:23.415766 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Domain-Name: Default May 19 13:32:23.415766 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Id: 40b09e85301c4e349b6714b13ae2e955 May 19 13:32:23.415766 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Name: tempest-DeleteServersTestJSON-948442396 May 19 13:32:23.415766 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Role: reader,member May 19 13:32:23.415766 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Roles: reader,member May 19 13:32:23.417774 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/40b09e85301c4e349b6714b13ae2e955"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/40b09e85301c4e349b6714b13ae2e955"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_40b09e85301c4e349b6714b13ae2e955", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/40b09e85301c4e349b6714b13ae2e955"}]}] May 19 13:32:23.417774 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Tenant: tempest-DeleteServersTestJSON-948442396 May 19 13:32:23.417774 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Tenant-Id: 40b09e85301c4e349b6714b13ae2e955 May 19 13:32:23.417774 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Tenant-Name: tempest-DeleteServersTestJSON-948442396 May 19 13:32:23.417774 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User: tempest-DeleteServersTestJSON-948442396-project May 19 13:32:23.417774 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Domain-Id: default May 19 13:32:23.417774 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Domain-Name: Default May 19 13:32:23.417774 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Id: 52ceb5b9477e431ba4a01adf2f3f485a May 19 13:32:23.417774 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Name: tempest-DeleteServersTestJSON-948442396-project May 19 13:32:23.417774 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: method: > May 19 13:32:23.417774 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: exception: Instance 080936a4-151d-4f4b-a750-937d342729db could not be found. May 19 13:32:23.417774 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: action_args: {'id': '080936a4-151d-4f4b-a750-937d342729db'} May 19 13:32:23.418612 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:32:23.418612 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:32:23.418612 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 13:32:23.418612 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 13:32:23.418612 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 13:32:23.418612 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 13:32:23.418612 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 13:32:23.418612 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 13:32:23.418612 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 13:32:23.418612 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 13:32:23.418612 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 080936a4-151d-4f4b-a750-937d342729db could not be found. May 19 13:32:23.418612 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:32:23.418612 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:32:23.418612 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:32:23.418612 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:32:23.418612 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:32:23.418612 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:32:23.418612 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:32:23.418612 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:32:23.418612 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:32:23.420181 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:32:23.420181 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 13:32:23.420181 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 13:32:23.420181 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 13:32:23.420181 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 13:32:23.420181 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 13:32:23.420181 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 13:32:23.420181 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 080936a4-151d-4f4b-a750-937d342729db could not be found. May 19 13:32:23.420181 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:32:23.420181 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:32:23.420181 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:32:23.420181 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:32:23.420181 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:32:23.420181 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:32:23.420181 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:32:23.420181 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:32:23.420181 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 080936a4-151d-4f4b-a750-937d342729db could not be found. May 19 13:32:23.420181 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:32:23.421378 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-57119066-252b-4b55-a30d-03def3c64770 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Returning 404 to user: Instance 080936a4-151d-4f4b-a750-937d342729db could not be found. {{(pid=120471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:32:23.421378 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-57119066-252b-4b55-a30d-03def3c64770 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] 10.222.0.24 "GET /compute/v2.1/servers/080936a4-151d-4f4b-a750-937d342729db" status: 404 len: 111 microversion: 2.1 time: 0.092319 May 19 13:32:23.421378 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 82/146] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:23 2022] GET /compute/v2.1/servers/080936a4-151d-4f4b-a750-937d342729db => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 13:32:23.597753 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-3fe4227c-e07e-4e4c-991b-950fe0e4a003 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:23.600276 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-3fe4227c-e07e-4e4c-991b-950fe0e4a003 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] [instance: 080936a4-151d-4f4b-a750-937d342729db] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:23.608257 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-3fe4227c-e07e-4e4c-991b-950fe0e4a003 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:23.608727 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-3fe4227c-e07e-4e4c-991b-950fe0e4a003 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:23.609631 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-3fe4227c-e07e-4e4c-991b-950fe0e4a003 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:23.610435 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-3fe4227c-e07e-4e4c-991b-950fe0e4a003 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:23.628207 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.wsgi [None req-3fe4227c-e07e-4e4c-991b-950fe0e4a003 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] HTTP exception thrown: Instance 080936a4-151d-4f4b-a750-937d342729db could not be found. May 19 13:32:23.632446 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-3fe4227c-e07e-4e4c-991b-950fe0e4a003 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Request method failure captured: May 19 13:32:23.632446 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: request: GET /compute/v2.1/servers/080936a4-151d-4f4b-a750-937d342729db/os-volume_attachments HTTP/1.1 May 19 13:32:23.632446 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Accept: application/json May 19 13:32:23.632446 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Accept-Encoding: identity May 19 13:32:23.632446 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Connection: close May 19 13:32:23.632446 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Content-Length: 0 May 19 13:32:23.632446 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Content-Type: application/json May 19 13:32:23.632446 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Host: 10.222.0.24 May 19 13:32:23.632446 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Openstack-System-Scope: None May 19 13:32:23.632446 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: User-Agent: python-urllib3/1.26.9 May 19 13:32:23.632446 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Auth-Token: gAAAAABihkaoiA4aiQjQnbsyWz4lLVsG9xjv_u-TDf5D_dWBZVGUtY8jIJWM5CjHzTRZIPMcntYcq-a4Ew17uTC9FRGQN_yIX6sLGwGvlpOID1Vwb6sRYYcVZ5ddzvBNGeFn_dtkhD12qP36CTTU_xN3iLUIo4Sk9ihAmtzLyuo7ibxdoE0xDrI May 19 13:32:23.632446 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Domain-Id: None May 19 13:32:23.632446 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Domain-Name: None May 19 13:32:23.632446 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Identity-Status: Confirmed May 19 13:32:23.632446 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Is-Admin-Project: True May 19 13:32:23.632446 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Domain-Id: default May 19 13:32:23.632446 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Domain-Name: Default May 19 13:32:23.632446 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Id: 40b09e85301c4e349b6714b13ae2e955 May 19 13:32:23.632446 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Name: tempest-DeleteServersTestJSON-948442396 May 19 13:32:23.632446 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Role: reader,member May 19 13:32:23.632446 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Roles: reader,member May 19 13:32:23.634077 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/40b09e85301c4e349b6714b13ae2e955"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/40b09e85301c4e349b6714b13ae2e955"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_40b09e85301c4e349b6714b13ae2e955", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/40b09e85301c4e349b6714b13ae2e955"}]}] May 19 13:32:23.634077 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant: tempest-DeleteServersTestJSON-948442396 May 19 13:32:23.634077 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant-Id: 40b09e85301c4e349b6714b13ae2e955 May 19 13:32:23.634077 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant-Name: tempest-DeleteServersTestJSON-948442396 May 19 13:32:23.634077 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User: tempest-DeleteServersTestJSON-948442396-project May 19 13:32:23.634077 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Domain-Id: default May 19 13:32:23.634077 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Domain-Name: Default May 19 13:32:23.634077 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Id: 52ceb5b9477e431ba4a01adf2f3f485a May 19 13:32:23.634077 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Name: tempest-DeleteServersTestJSON-948442396-project May 19 13:32:23.634077 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: method: > May 19 13:32:23.634077 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: exception: Instance 080936a4-151d-4f4b-a750-937d342729db could not be found. May 19 13:32:23.634077 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: action_args: {'server_id': '080936a4-151d-4f4b-a750-937d342729db'} May 19 13:32:23.634907 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:32:23.634907 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:32:23.634907 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 13:32:23.634907 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 13:32:23.634907 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 13:32:23.634907 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 13:32:23.634907 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 13:32:23.634907 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 13:32:23.634907 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 13:32:23.634907 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 13:32:23.634907 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 080936a4-151d-4f4b-a750-937d342729db could not be found. May 19 13:32:23.634907 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:32:23.634907 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:32:23.634907 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:32:23.634907 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:32:23.634907 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:32:23.634907 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:32:23.634907 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:32:23.634907 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:32:23.634907 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:32:23.636215 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:32:23.636215 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 19 13:32:23.636215 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 13:32:23.636215 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 19 13:32:23.636215 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 13:32:23.636215 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 19 13:32:23.636215 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 19 13:32:23.636215 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 13:32:23.636215 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 13:32:23.636215 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 080936a4-151d-4f4b-a750-937d342729db could not be found. May 19 13:32:23.636215 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:32:23.636215 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:32:23.636215 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:32:23.636215 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:32:23.636215 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:32:23.636215 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:32:23.636215 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:32:23.636215 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:32:23.636215 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 080936a4-151d-4f4b-a750-937d342729db could not be found. May 19 13:32:23.636215 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:32:23.637498 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-3fe4227c-e07e-4e4c-991b-950fe0e4a003 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Returning 404 to user: Instance 080936a4-151d-4f4b-a750-937d342729db could not be found. {{(pid=120472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:32:23.637498 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-3fe4227c-e07e-4e4c-991b-950fe0e4a003 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] 10.222.0.24 "GET /compute/v2.1/servers/080936a4-151d-4f4b-a750-937d342729db/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.040820 May 19 13:32:23.637498 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 65/147] 10.222.0.24 () {58 vars in 1301 bytes} [Thu May 19 13:32:23 2022] GET /compute/v2.1/servers/080936a4-151d-4f4b-a750-937d342729db/os-volume_attachments => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 13:32:23.879210 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-14e10e6b-718b-4a5f-8aba-e18785764255 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:23.880519 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-14e10e6b-718b-4a5f-8aba-e18785764255 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] [instance: 718d3de9-c471-44df-8622-ce92537497bf] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:23.887231 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-14e10e6b-718b-4a5f-8aba-e18785764255 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:23.887679 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-14e10e6b-718b-4a5f-8aba-e18785764255 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:23.888463 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-14e10e6b-718b-4a5f-8aba-e18785764255 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:23.888885 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-14e10e6b-718b-4a5f-8aba-e18785764255 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:24.044735 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-14e10e6b-718b-4a5f-8aba-e18785764255 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fafefcbb62bf4284a8a9da5d6c0a4609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894127095d6445f5a2eafc9906ce5cf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:24.052141 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-14e10e6b-718b-4a5f-8aba-e18785764255 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] 10.222.0.24 "GET /compute/v2.1/servers/718d3de9-c471-44df-8622-ce92537497bf" status: 200 len: 1314 microversion: 2.1 time: 0.176763 May 19 13:32:24.052703 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 83/148] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:23 2022] GET /compute/v2.1/servers/718d3de9-c471-44df-8622-ce92537497bf => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:32:24.171721 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-a11d58ed-14e5-4e19-82bf-d993f3e05497 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:24.172498 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-a11d58ed-14e5-4e19-82bf-d993f3e05497 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: bb839e22-971b-4313-be06-20e09838215a] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:24.179253 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-a11d58ed-14e5-4e19-82bf-d993f3e05497 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:24.179702 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-a11d58ed-14e5-4e19-82bf-d993f3e05497 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:24.180460 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-a11d58ed-14e5-4e19-82bf-d993f3e05497 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:24.180892 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-a11d58ed-14e5-4e19-82bf-d993f3e05497 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:24.325790 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-a11d58ed-14e5-4e19-82bf-d993f3e05497 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:24.333196 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-a11d58ed-14e5-4e19-82bf-d993f3e05497 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a" status: 200 len: 1522 microversion: 2.1 time: 0.165424 May 19 13:32:24.333785 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 66/149] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:24 2022] GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:32:25.069030 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-f52a60cb-8631-4ed5-8862-e4f72daeec85 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:25.069685 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-f52a60cb-8631-4ed5-8862-e4f72daeec85 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] [instance: 718d3de9-c471-44df-8622-ce92537497bf] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:25.076057 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-f52a60cb-8631-4ed5-8862-e4f72daeec85 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:25.076716 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-f52a60cb-8631-4ed5-8862-e4f72daeec85 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:25.077509 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-f52a60cb-8631-4ed5-8862-e4f72daeec85 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:25.077920 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-f52a60cb-8631-4ed5-8862-e4f72daeec85 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:25.219329 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-f52a60cb-8631-4ed5-8862-e4f72daeec85 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fafefcbb62bf4284a8a9da5d6c0a4609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894127095d6445f5a2eafc9906ce5cf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:25.226864 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-f52a60cb-8631-4ed5-8862-e4f72daeec85 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] 10.222.0.24 "GET /compute/v2.1/servers/718d3de9-c471-44df-8622-ce92537497bf" status: 200 len: 1314 microversion: 2.1 time: 0.161836 May 19 13:32:25.227435 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 84/150] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:25 2022] GET /compute/v2.1/servers/718d3de9-c471-44df-8622-ce92537497bf => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:32:25.349989 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-1f3a069d-10c1-431c-ba70-37b3ff3e1914 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:25.350598 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-1f3a069d-10c1-431c-ba70-37b3ff3e1914 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: bb839e22-971b-4313-be06-20e09838215a] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:25.357209 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-1f3a069d-10c1-431c-ba70-37b3ff3e1914 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:25.357701 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-1f3a069d-10c1-431c-ba70-37b3ff3e1914 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:25.358469 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-1f3a069d-10c1-431c-ba70-37b3ff3e1914 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:25.358902 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-1f3a069d-10c1-431c-ba70-37b3ff3e1914 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:25.485478 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_cell0:SELECT=2 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:32:25.490648 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-1f3a069d-10c1-431c-ba70-37b3ff3e1914 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:25.498480 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-1f3a069d-10c1-431c-ba70-37b3ff3e1914 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a" status: 200 len: 1522 microversion: 2.1 time: 0.152281 May 19 13:32:25.499004 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 67/151] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:25 2022] GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:32:26.244772 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-877b06d2-741d-4b52-897c-450ad8489275 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:26.245380 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-877b06d2-741d-4b52-897c-450ad8489275 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] [instance: 718d3de9-c471-44df-8622-ce92537497bf] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:26.247421 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_cell0:SELECT=2 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:32:26.248073 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_cell0:SELECT=6 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:32:26.254234 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-877b06d2-741d-4b52-897c-450ad8489275 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:26.254670 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-877b06d2-741d-4b52-897c-450ad8489275 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:26.255431 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-877b06d2-741d-4b52-897c-450ad8489275 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:26.255846 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-877b06d2-741d-4b52-897c-450ad8489275 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:26.274455 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:32:26.395836 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-877b06d2-741d-4b52-897c-450ad8489275 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fafefcbb62bf4284a8a9da5d6c0a4609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894127095d6445f5a2eafc9906ce5cf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:26.403366 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-877b06d2-741d-4b52-897c-450ad8489275 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] 10.222.0.24 "GET /compute/v2.1/servers/718d3de9-c471-44df-8622-ce92537497bf" status: 200 len: 1314 microversion: 2.1 time: 0.162592 May 19 13:32:26.404086 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 85/152] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:26 2022] GET /compute/v2.1/servers/718d3de9-c471-44df-8622-ce92537497bf => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:32:26.516009 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-78344689-1a96-4b31-bd79-7a5bec251019 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:26.516538 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-78344689-1a96-4b31-bd79-7a5bec251019 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: bb839e22-971b-4313-be06-20e09838215a] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:26.523322 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-78344689-1a96-4b31-bd79-7a5bec251019 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:26.523779 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-78344689-1a96-4b31-bd79-7a5bec251019 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:26.524524 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-78344689-1a96-4b31-bd79-7a5bec251019 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:26.524949 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-78344689-1a96-4b31-bd79-7a5bec251019 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:26.663291 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-78344689-1a96-4b31-bd79-7a5bec251019 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:26.671887 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-78344689-1a96-4b31-bd79-7a5bec251019 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a" status: 200 len: 1522 microversion: 2.1 time: 0.160184 May 19 13:32:26.672441 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 68/153] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:26 2022] GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:32:27.425823 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-a0dc8f38-0f97-41b0-96c2-0dd30871fa6e tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:27.427831 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-a0dc8f38-0f97-41b0-96c2-0dd30871fa6e tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] [instance: 718d3de9-c471-44df-8622-ce92537497bf] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:27.434252 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-a0dc8f38-0f97-41b0-96c2-0dd30871fa6e tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:27.434921 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-a0dc8f38-0f97-41b0-96c2-0dd30871fa6e tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:27.435970 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-a0dc8f38-0f97-41b0-96c2-0dd30871fa6e tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:27.436313 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-a0dc8f38-0f97-41b0-96c2-0dd30871fa6e tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:27.582733 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-a0dc8f38-0f97-41b0-96c2-0dd30871fa6e tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fafefcbb62bf4284a8a9da5d6c0a4609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894127095d6445f5a2eafc9906ce5cf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:27.591932 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-a0dc8f38-0f97-41b0-96c2-0dd30871fa6e tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] 10.222.0.24 "GET /compute/v2.1/servers/718d3de9-c471-44df-8622-ce92537497bf" status: 200 len: 1314 microversion: 2.1 time: 0.170247 May 19 13:32:27.592545 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 86/154] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:27 2022] GET /compute/v2.1/servers/718d3de9-c471-44df-8622-ce92537497bf => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:32:27.689543 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-a06f3b0d-5902-4b39-9bac-1d52a486c288 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:27.690145 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-a06f3b0d-5902-4b39-9bac-1d52a486c288 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: bb839e22-971b-4313-be06-20e09838215a] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:27.696405 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-a06f3b0d-5902-4b39-9bac-1d52a486c288 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:27.696844 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-a06f3b0d-5902-4b39-9bac-1d52a486c288 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:27.698142 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-a06f3b0d-5902-4b39-9bac-1d52a486c288 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:27.698142 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-a06f3b0d-5902-4b39-9bac-1d52a486c288 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:27.912874 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-a06f3b0d-5902-4b39-9bac-1d52a486c288 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:27.923614 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-a06f3b0d-5902-4b39-9bac-1d52a486c288 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a" status: 200 len: 1522 microversion: 2.1 time: 0.237895 May 19 13:32:27.924178 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 69/155] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:27 2022] GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:32:28.113298 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-c162df95-590e-4295-8f3d-9b263cf88ae7 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:28.113830 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-c162df95-590e-4295-8f3d-9b263cf88ae7 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] [instance: 080936a4-151d-4f4b-a750-937d342729db] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:28.119947 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-c162df95-590e-4295-8f3d-9b263cf88ae7 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:28.120582 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-c162df95-590e-4295-8f3d-9b263cf88ae7 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:28.121516 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-c162df95-590e-4295-8f3d-9b263cf88ae7 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:28.122088 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-c162df95-590e-4295-8f3d-9b263cf88ae7 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:28.137316 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.wsgi [None req-c162df95-590e-4295-8f3d-9b263cf88ae7 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] HTTP exception thrown: Instance 080936a4-151d-4f4b-a750-937d342729db could not be found. May 19 13:32:28.139459 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-c162df95-590e-4295-8f3d-9b263cf88ae7 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Request method failure captured: May 19 13:32:28.139459 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: request: DELETE /compute/v2.1/servers/080936a4-151d-4f4b-a750-937d342729db HTTP/1.1 May 19 13:32:28.139459 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Accept: application/json May 19 13:32:28.139459 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Accept-Encoding: identity May 19 13:32:28.139459 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Connection: close May 19 13:32:28.139459 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Content-Length: 0 May 19 13:32:28.139459 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Content-Type: application/json May 19 13:32:28.139459 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Host: 10.222.0.24 May 19 13:32:28.139459 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Openstack-System-Scope: None May 19 13:32:28.139459 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: User-Agent: python-urllib3/1.26.9 May 19 13:32:28.139459 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Auth-Token: gAAAAABihkaoiA4aiQjQnbsyWz4lLVsG9xjv_u-TDf5D_dWBZVGUtY8jIJWM5CjHzTRZIPMcntYcq-a4Ew17uTC9FRGQN_yIX6sLGwGvlpOID1Vwb6sRYYcVZ5ddzvBNGeFn_dtkhD12qP36CTTU_xN3iLUIo4Sk9ihAmtzLyuo7ibxdoE0xDrI May 19 13:32:28.139459 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Domain-Id: None May 19 13:32:28.139459 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Domain-Name: None May 19 13:32:28.139459 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Identity-Status: Confirmed May 19 13:32:28.139459 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Is-Admin-Project: True May 19 13:32:28.139459 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Domain-Id: default May 19 13:32:28.139459 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Domain-Name: Default May 19 13:32:28.139459 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Id: 40b09e85301c4e349b6714b13ae2e955 May 19 13:32:28.139459 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Name: tempest-DeleteServersTestJSON-948442396 May 19 13:32:28.139459 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Role: reader,member May 19 13:32:28.139459 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Roles: reader,member May 19 13:32:28.140884 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/40b09e85301c4e349b6714b13ae2e955"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/40b09e85301c4e349b6714b13ae2e955"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_40b09e85301c4e349b6714b13ae2e955", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/40b09e85301c4e349b6714b13ae2e955"}]}] May 19 13:32:28.140884 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Tenant: tempest-DeleteServersTestJSON-948442396 May 19 13:32:28.140884 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Tenant-Id: 40b09e85301c4e349b6714b13ae2e955 May 19 13:32:28.140884 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Tenant-Name: tempest-DeleteServersTestJSON-948442396 May 19 13:32:28.140884 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User: tempest-DeleteServersTestJSON-948442396-project May 19 13:32:28.140884 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Domain-Id: default May 19 13:32:28.140884 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Domain-Name: Default May 19 13:32:28.140884 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Id: 52ceb5b9477e431ba4a01adf2f3f485a May 19 13:32:28.140884 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Name: tempest-DeleteServersTestJSON-948442396-project May 19 13:32:28.140884 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: method: > May 19 13:32:28.140884 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: exception: Instance 080936a4-151d-4f4b-a750-937d342729db could not be found. May 19 13:32:28.140884 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: action_args: {'id': '080936a4-151d-4f4b-a750-937d342729db'} May 19 13:32:28.141714 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:32:28.141714 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:32:28.141714 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 13:32:28.141714 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 13:32:28.141714 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 13:32:28.141714 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 13:32:28.141714 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 13:32:28.141714 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 13:32:28.141714 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 13:32:28.141714 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 13:32:28.141714 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 080936a4-151d-4f4b-a750-937d342729db could not be found. May 19 13:32:28.141714 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:32:28.141714 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:32:28.141714 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:32:28.141714 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:32:28.141714 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:32:28.141714 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:32:28.141714 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:32:28.141714 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:32:28.141714 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:32:28.142990 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:32:28.142990 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 13:32:28.142990 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 13:32:28.142990 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 13:32:28.142990 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 13:32:28.142990 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 13:32:28.142990 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 13:32:28.142990 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 13:32:28.142990 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 13:32:28.142990 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 080936a4-151d-4f4b-a750-937d342729db could not be found. May 19 13:32:28.142990 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:32:28.142990 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:32:28.142990 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:32:28.142990 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:32:28.142990 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:32:28.142990 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:32:28.142990 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:32:28.142990 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:32:28.142990 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 080936a4-151d-4f4b-a750-937d342729db could not be found. May 19 13:32:28.142990 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:32:28.144277 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-c162df95-590e-4295-8f3d-9b263cf88ae7 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Returning 404 to user: Instance 080936a4-151d-4f4b-a750-937d342729db could not be found. {{(pid=120471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:32:28.144628 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-c162df95-590e-4295-8f3d-9b263cf88ae7 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] 10.222.0.24 "DELETE /compute/v2.1/servers/080936a4-151d-4f4b-a750-937d342729db" status: 404 len: 111 microversion: 2.1 time: 0.035003 May 19 13:32:28.145297 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 87/156] 10.222.0.24 () {58 vars in 1238 bytes} [Thu May 19 13:32:28 2022] DELETE /compute/v2.1/servers/080936a4-151d-4f4b-a750-937d342729db => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 13:32:28.154234 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-4dc7e14c-4f8e-4966-b2d7-f3932a4d0658 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:28.154934 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-4dc7e14c-4f8e-4966-b2d7-f3932a4d0658 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] [instance: 080936a4-151d-4f4b-a750-937d342729db] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:28.161448 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-4dc7e14c-4f8e-4966-b2d7-f3932a4d0658 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:28.161963 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-4dc7e14c-4f8e-4966-b2d7-f3932a4d0658 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:28.162897 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-4dc7e14c-4f8e-4966-b2d7-f3932a4d0658 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:28.163323 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-4dc7e14c-4f8e-4966-b2d7-f3932a4d0658 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:28.177460 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.wsgi [None req-4dc7e14c-4f8e-4966-b2d7-f3932a4d0658 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] HTTP exception thrown: Instance 080936a4-151d-4f4b-a750-937d342729db could not be found. May 19 13:32:28.179639 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-4dc7e14c-4f8e-4966-b2d7-f3932a4d0658 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Request method failure captured: May 19 13:32:28.179639 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: request: GET /compute/v2.1/servers/080936a4-151d-4f4b-a750-937d342729db HTTP/1.1 May 19 13:32:28.179639 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Accept: application/json May 19 13:32:28.179639 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Accept-Encoding: identity May 19 13:32:28.179639 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Connection: close May 19 13:32:28.179639 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Content-Length: 0 May 19 13:32:28.179639 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Content-Type: application/json May 19 13:32:28.179639 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Host: 10.222.0.24 May 19 13:32:28.179639 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Openstack-System-Scope: None May 19 13:32:28.179639 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: User-Agent: python-urllib3/1.26.9 May 19 13:32:28.179639 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Auth-Token: gAAAAABihkaoiA4aiQjQnbsyWz4lLVsG9xjv_u-TDf5D_dWBZVGUtY8jIJWM5CjHzTRZIPMcntYcq-a4Ew17uTC9FRGQN_yIX6sLGwGvlpOID1Vwb6sRYYcVZ5ddzvBNGeFn_dtkhD12qP36CTTU_xN3iLUIo4Sk9ihAmtzLyuo7ibxdoE0xDrI May 19 13:32:28.179639 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Domain-Id: None May 19 13:32:28.179639 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Domain-Name: None May 19 13:32:28.179639 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Identity-Status: Confirmed May 19 13:32:28.179639 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Is-Admin-Project: True May 19 13:32:28.179639 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Domain-Id: default May 19 13:32:28.179639 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Domain-Name: Default May 19 13:32:28.179639 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Id: 40b09e85301c4e349b6714b13ae2e955 May 19 13:32:28.179639 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Name: tempest-DeleteServersTestJSON-948442396 May 19 13:32:28.179639 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Role: reader,member May 19 13:32:28.179639 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Roles: reader,member May 19 13:32:28.180920 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/40b09e85301c4e349b6714b13ae2e955"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/40b09e85301c4e349b6714b13ae2e955"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_40b09e85301c4e349b6714b13ae2e955", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/40b09e85301c4e349b6714b13ae2e955"}]}] May 19 13:32:28.180920 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant: tempest-DeleteServersTestJSON-948442396 May 19 13:32:28.180920 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant-Id: 40b09e85301c4e349b6714b13ae2e955 May 19 13:32:28.180920 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant-Name: tempest-DeleteServersTestJSON-948442396 May 19 13:32:28.180920 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User: tempest-DeleteServersTestJSON-948442396-project May 19 13:32:28.180920 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Domain-Id: default May 19 13:32:28.180920 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Domain-Name: Default May 19 13:32:28.180920 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Id: 52ceb5b9477e431ba4a01adf2f3f485a May 19 13:32:28.180920 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Name: tempest-DeleteServersTestJSON-948442396-project May 19 13:32:28.180920 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: method: > May 19 13:32:28.180920 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: exception: Instance 080936a4-151d-4f4b-a750-937d342729db could not be found. May 19 13:32:28.180920 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: action_args: {'id': '080936a4-151d-4f4b-a750-937d342729db'} May 19 13:32:28.181726 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:32:28.181726 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:32:28.181726 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 13:32:28.181726 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 13:32:28.181726 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 13:32:28.181726 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 13:32:28.181726 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 13:32:28.181726 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 13:32:28.181726 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 13:32:28.181726 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 13:32:28.181726 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 080936a4-151d-4f4b-a750-937d342729db could not be found. May 19 13:32:28.181726 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:32:28.181726 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:32:28.181726 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:32:28.181726 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:32:28.181726 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:32:28.181726 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:32:28.181726 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:32:28.181726 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:32:28.181726 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:32:28.182779 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:32:28.182779 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 13:32:28.182779 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 13:32:28.182779 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 13:32:28.182779 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 13:32:28.182779 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 13:32:28.182779 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 13:32:28.182779 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 080936a4-151d-4f4b-a750-937d342729db could not be found. May 19 13:32:28.182779 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:32:28.182779 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:32:28.182779 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:32:28.182779 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:32:28.182779 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:32:28.182779 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:32:28.182779 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:32:28.182779 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:32:28.182779 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 080936a4-151d-4f4b-a750-937d342729db could not be found. May 19 13:32:28.182779 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:32:28.183816 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-4dc7e14c-4f8e-4966-b2d7-f3932a4d0658 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] Returning 404 to user: Instance 080936a4-151d-4f4b-a750-937d342729db could not be found. {{(pid=120472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:32:28.183816 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-4dc7e14c-4f8e-4966-b2d7-f3932a4d0658 tempest-DeleteServersTestJSON-948442396 tempest-DeleteServersTestJSON-948442396-project] 10.222.0.24 "GET /compute/v2.1/servers/080936a4-151d-4f4b-a750-937d342729db" status: 404 len: 111 microversion: 2.1 time: 0.031492 May 19 13:32:28.183816 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 70/157] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:28 2022] GET /compute/v2.1/servers/080936a4-151d-4f4b-a750-937d342729db => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 13:32:28.608490 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-d111f6e6-9388-4009-b680-aaeb61cd90c5 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:28.609916 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-d111f6e6-9388-4009-b680-aaeb61cd90c5 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] [instance: 718d3de9-c471-44df-8622-ce92537497bf] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:28.616403 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-d111f6e6-9388-4009-b680-aaeb61cd90c5 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:28.616964 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-d111f6e6-9388-4009-b680-aaeb61cd90c5 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:28.618049 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-d111f6e6-9388-4009-b680-aaeb61cd90c5 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:28.618577 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-d111f6e6-9388-4009-b680-aaeb61cd90c5 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:28.760849 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-d111f6e6-9388-4009-b680-aaeb61cd90c5 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fafefcbb62bf4284a8a9da5d6c0a4609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894127095d6445f5a2eafc9906ce5cf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:28.768663 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-d111f6e6-9388-4009-b680-aaeb61cd90c5 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] 10.222.0.24 "GET /compute/v2.1/servers/718d3de9-c471-44df-8622-ce92537497bf" status: 200 len: 1314 microversion: 2.1 time: 0.164338 May 19 13:32:28.769362 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 88/158] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:28 2022] GET /compute/v2.1/servers/718d3de9-c471-44df-8622-ce92537497bf => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:32:28.940692 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-9cf683f4-44cc-4a6e-9192-7729b5ab1348 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:28.941293 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-9cf683f4-44cc-4a6e-9192-7729b5ab1348 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: bb839e22-971b-4313-be06-20e09838215a] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:28.947940 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-9cf683f4-44cc-4a6e-9192-7729b5ab1348 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:28.948441 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-9cf683f4-44cc-4a6e-9192-7729b5ab1348 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:28.949183 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-9cf683f4-44cc-4a6e-9192-7729b5ab1348 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:28.949619 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-9cf683f4-44cc-4a6e-9192-7729b5ab1348 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:29.161710 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-9cf683f4-44cc-4a6e-9192-7729b5ab1348 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:29.180758 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-9cf683f4-44cc-4a6e-9192-7729b5ab1348 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a" status: 200 len: 1522 microversion: 2.1 time: 0.241844 May 19 13:32:29.193660 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 71/159] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:28 2022] GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a => generated 1522 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:32:29.785595 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-c708816b-f2c2-40e0-ab85-8ebecefe5e6e tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:29.786768 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-c708816b-f2c2-40e0-ab85-8ebecefe5e6e tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] [instance: 718d3de9-c471-44df-8622-ce92537497bf] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:29.793299 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-c708816b-f2c2-40e0-ab85-8ebecefe5e6e tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:29.793768 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-c708816b-f2c2-40e0-ab85-8ebecefe5e6e tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:29.794774 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-c708816b-f2c2-40e0-ab85-8ebecefe5e6e tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:29.795355 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-c708816b-f2c2-40e0-ab85-8ebecefe5e6e tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:30.204080 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-0b2c2931-ee73-4b41-8413-9325a510dc96 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:30.205443 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-0b2c2931-ee73-4b41-8413-9325a510dc96 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: bb839e22-971b-4313-be06-20e09838215a] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:30.208778 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-c708816b-f2c2-40e0-ab85-8ebecefe5e6e tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fafefcbb62bf4284a8a9da5d6c0a4609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894127095d6445f5a2eafc9906ce5cf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:30.217173 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-c708816b-f2c2-40e0-ab85-8ebecefe5e6e tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] 10.222.0.24 "GET /compute/v2.1/servers/718d3de9-c471-44df-8622-ce92537497bf" status: 200 len: 1314 microversion: 2.1 time: 0.434801 May 19 13:32:30.217173 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 89/160] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:29 2022] GET /compute/v2.1/servers/718d3de9-c471-44df-8622-ce92537497bf => generated 1314 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:32:30.226677 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-0b2c2931-ee73-4b41-8413-9325a510dc96 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:30.226677 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-0b2c2931-ee73-4b41-8413-9325a510dc96 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:30.226677 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-0b2c2931-ee73-4b41-8413-9325a510dc96 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:30.226677 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-0b2c2931-ee73-4b41-8413-9325a510dc96 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:30.455284 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-0b2c2931-ee73-4b41-8413-9325a510dc96 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:30.464445 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-0b2c2931-ee73-4b41-8413-9325a510dc96 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a" status: 200 len: 1522 microversion: 2.1 time: 0.264682 May 19 13:32:30.465209 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 72/161] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:30 2022] GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a => generated 1522 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:32:31.233634 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-afe1135e-41ee-44a9-b4dd-b31e4b5a9ffb tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:31.235141 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-afe1135e-41ee-44a9-b4dd-b31e4b5a9ffb tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] [instance: 718d3de9-c471-44df-8622-ce92537497bf] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:31.249565 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-afe1135e-41ee-44a9-b4dd-b31e4b5a9ffb tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:31.251241 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-afe1135e-41ee-44a9-b4dd-b31e4b5a9ffb tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:31.253505 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-afe1135e-41ee-44a9-b4dd-b31e4b5a9ffb tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:31.254241 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-afe1135e-41ee-44a9-b4dd-b31e4b5a9ffb tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:31.487466 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-4ef716ff-80b9-42ff-a7ec-fc0ccc1a7b3d tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:31.488595 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-4ef716ff-80b9-42ff-a7ec-fc0ccc1a7b3d tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: bb839e22-971b-4313-be06-20e09838215a] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:31.502283 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-4ef716ff-80b9-42ff-a7ec-fc0ccc1a7b3d tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:31.503087 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-4ef716ff-80b9-42ff-a7ec-fc0ccc1a7b3d tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:31.504133 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-4ef716ff-80b9-42ff-a7ec-fc0ccc1a7b3d tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:31.504865 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-4ef716ff-80b9-42ff-a7ec-fc0ccc1a7b3d tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:31.599957 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-afe1135e-41ee-44a9-b4dd-b31e4b5a9ffb tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fafefcbb62bf4284a8a9da5d6c0a4609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894127095d6445f5a2eafc9906ce5cf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:31.627183 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-afe1135e-41ee-44a9-b4dd-b31e4b5a9ffb tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] 10.222.0.24 "GET /compute/v2.1/servers/718d3de9-c471-44df-8622-ce92537497bf" status: 200 len: 1314 microversion: 2.1 time: 0.397818 May 19 13:32:31.627660 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 90/162] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:31 2022] GET /compute/v2.1/servers/718d3de9-c471-44df-8622-ce92537497bf => generated 1314 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:32:31.744614 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-4ef716ff-80b9-42ff-a7ec-fc0ccc1a7b3d tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:31.755738 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-4ef716ff-80b9-42ff-a7ec-fc0ccc1a7b3d tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a" status: 200 len: 1522 microversion: 2.1 time: 0.277418 May 19 13:32:31.756312 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 73/163] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:31 2022] GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a => generated 1522 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:32:32.645466 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-646e2524-5091-4638-9de3-ca52acb5b925 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:32.646194 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-646e2524-5091-4638-9de3-ca52acb5b925 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] [instance: 718d3de9-c471-44df-8622-ce92537497bf] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:32.661511 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-646e2524-5091-4638-9de3-ca52acb5b925 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:32.662043 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-646e2524-5091-4638-9de3-ca52acb5b925 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:32.662884 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-646e2524-5091-4638-9de3-ca52acb5b925 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:32.663380 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-646e2524-5091-4638-9de3-ca52acb5b925 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:32.772805 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-0a33a63a-0afa-472f-8a41-0217b313d3a6 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:32.773525 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-0a33a63a-0afa-472f-8a41-0217b313d3a6 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: bb839e22-971b-4313-be06-20e09838215a] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:32.780402 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-0a33a63a-0afa-472f-8a41-0217b313d3a6 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:32.781111 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-0a33a63a-0afa-472f-8a41-0217b313d3a6 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:32.782103 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-0a33a63a-0afa-472f-8a41-0217b313d3a6 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:32.782533 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-0a33a63a-0afa-472f-8a41-0217b313d3a6 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:32.880437 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-646e2524-5091-4638-9de3-ca52acb5b925 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fafefcbb62bf4284a8a9da5d6c0a4609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894127095d6445f5a2eafc9906ce5cf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:32.889124 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-646e2524-5091-4638-9de3-ca52acb5b925 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] 10.222.0.24 "GET /compute/v2.1/servers/718d3de9-c471-44df-8622-ce92537497bf" status: 200 len: 1314 microversion: 2.1 time: 0.248252 May 19 13:32:32.889624 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 91/164] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:32 2022] GET /compute/v2.1/servers/718d3de9-c471-44df-8622-ce92537497bf => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:32:32.943445 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-0a33a63a-0afa-472f-8a41-0217b313d3a6 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:32.951436 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-0a33a63a-0afa-472f-8a41-0217b313d3a6 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a" status: 200 len: 1522 microversion: 2.1 time: 0.182911 May 19 13:32:32.951946 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 74/165] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:32 2022] GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:32:33.844341 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [req-875eec6f-1ba7-47fc-bada-7e35831d54bd req-d987eb0f-4995-4c0a-8283-589240049963 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "718d3de9-c471-44df-8622-ce92537497bf", "name": "network-vif-plugged", "status": "completed", "tag": "dbe4a516-99f2-45f8-9ab5-3ed1503a5ea7"}]} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:32:33.855836 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-875eec6f-1ba7-47fc-bada-7e35831d54bd req-d987eb0f-4995-4c0a-8283-589240049963 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:33.857434 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-875eec6f-1ba7-47fc-bada-7e35831d54bd req-d987eb0f-4995-4c0a-8283-589240049963 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:33.872048 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.compute.server_external_events [req-875eec6f-1ba7-47fc-bada-7e35831d54bd req-d987eb0f-4995-4c0a-8283-589240049963 service nova] Creating event network-vif-plugged:dbe4a516-99f2-45f8-9ab5-3ed1503a5ea7 for instance 718d3de9-c471-44df-8622-ce92537497bf on hv-cinder-84112 May 19 13:32:33.879119 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [req-875eec6f-1ba7-47fc-bada-7e35831d54bd req-d987eb0f-4995-4c0a-8283-589240049963 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040257 May 19 13:32:33.879759 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 92/166] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:32:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 13:32:33.906538 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-e0711274-d6f2-4f70-ab18-4f25c74f5fdf tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:33.907159 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-e0711274-d6f2-4f70-ab18-4f25c74f5fdf tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] [instance: 718d3de9-c471-44df-8622-ce92537497bf] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:33.913510 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-e0711274-d6f2-4f70-ab18-4f25c74f5fdf tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:33.914160 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-e0711274-d6f2-4f70-ab18-4f25c74f5fdf tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:33.915153 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-e0711274-d6f2-4f70-ab18-4f25c74f5fdf tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:33.915770 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-e0711274-d6f2-4f70-ab18-4f25c74f5fdf tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:33.969254 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-7eeff6d8-cbfb-4034-ad67-29577087cd35 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:33.970094 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-7eeff6d8-cbfb-4034-ad67-29577087cd35 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: bb839e22-971b-4313-be06-20e09838215a] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:33.976509 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-7eeff6d8-cbfb-4034-ad67-29577087cd35 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:33.977068 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-7eeff6d8-cbfb-4034-ad67-29577087cd35 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:33.977960 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-7eeff6d8-cbfb-4034-ad67-29577087cd35 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:33.978504 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-7eeff6d8-cbfb-4034-ad67-29577087cd35 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:34.061487 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-e0711274-d6f2-4f70-ab18-4f25c74f5fdf tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fafefcbb62bf4284a8a9da5d6c0a4609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894127095d6445f5a2eafc9906ce5cf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:34.069066 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-e0711274-d6f2-4f70-ab18-4f25c74f5fdf tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] 10.222.0.24 "GET /compute/v2.1/servers/718d3de9-c471-44df-8622-ce92537497bf" status: 200 len: 1314 microversion: 2.1 time: 0.166953 May 19 13:32:34.069669 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 75/167] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:33 2022] GET /compute/v2.1/servers/718d3de9-c471-44df-8622-ce92537497bf => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:32:34.189310 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-7eeff6d8-cbfb-4034-ad67-29577087cd35 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:34.197103 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-7eeff6d8-cbfb-4034-ad67-29577087cd35 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a" status: 200 len: 1522 microversion: 2.1 time: 0.232310 May 19 13:32:34.197700 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 93/168] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:33 2022] GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:32:35.086726 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-ecdf585d-4d9a-432c-a97e-e726767c1b8b tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:35.087766 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-ecdf585d-4d9a-432c-a97e-e726767c1b8b tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] [instance: 718d3de9-c471-44df-8622-ce92537497bf] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:35.095217 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-ecdf585d-4d9a-432c-a97e-e726767c1b8b tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:35.095784 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-ecdf585d-4d9a-432c-a97e-e726767c1b8b tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:35.096725 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-ecdf585d-4d9a-432c-a97e-e726767c1b8b tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:35.097265 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-ecdf585d-4d9a-432c-a97e-e726767c1b8b tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:35.214979 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-44b200ad-84c3-42f9-bcda-bff86d7ca7fa tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:35.217158 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-44b200ad-84c3-42f9-bcda-bff86d7ca7fa tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: bb839e22-971b-4313-be06-20e09838215a] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:35.226952 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-44b200ad-84c3-42f9-bcda-bff86d7ca7fa tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:35.227377 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-44b200ad-84c3-42f9-bcda-bff86d7ca7fa tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:35.237544 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-44b200ad-84c3-42f9-bcda-bff86d7ca7fa tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:35.243875 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-ecdf585d-4d9a-432c-a97e-e726767c1b8b tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fafefcbb62bf4284a8a9da5d6c0a4609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894127095d6445f5a2eafc9906ce5cf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:35.247245 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-ecdf585d-4d9a-432c-a97e-e726767c1b8b tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] 10.222.0.24 "GET /compute/v2.1/servers/718d3de9-c471-44df-8622-ce92537497bf" status: 200 len: 1314 microversion: 2.1 time: 0.164788 May 19 13:32:35.247675 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-44b200ad-84c3-42f9-bcda-bff86d7ca7fa tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:35.258115 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 76/169] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:35 2022] GET /compute/v2.1/servers/718d3de9-c471-44df-8622-ce92537497bf => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:32:35.397535 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-44b200ad-84c3-42f9-bcda-bff86d7ca7fa tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:35.406313 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-44b200ad-84c3-42f9-bcda-bff86d7ca7fa tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a" status: 200 len: 1522 microversion: 2.1 time: 0.195224 May 19 13:32:35.407166 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 94/170] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:35 2022] GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:32:36.266139 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-ccc80ce8-4700-4234-97cb-676ff4709f71 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:36.267582 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-ccc80ce8-4700-4234-97cb-676ff4709f71 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] [instance: 718d3de9-c471-44df-8622-ce92537497bf] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:36.275116 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-ccc80ce8-4700-4234-97cb-676ff4709f71 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:36.276005 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-ccc80ce8-4700-4234-97cb-676ff4709f71 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:36.277252 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-ccc80ce8-4700-4234-97cb-676ff4709f71 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:36.277890 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-ccc80ce8-4700-4234-97cb-676ff4709f71 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:36.424229 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-dab6ed96-7cde-43b2-b589-4456d2426e9b tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:36.424836 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-dab6ed96-7cde-43b2-b589-4456d2426e9b tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: bb839e22-971b-4313-be06-20e09838215a] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:36.437151 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-dab6ed96-7cde-43b2-b589-4456d2426e9b tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:36.446366 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-dab6ed96-7cde-43b2-b589-4456d2426e9b tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:36.447549 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-dab6ed96-7cde-43b2-b589-4456d2426e9b tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:36.449195 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-dab6ed96-7cde-43b2-b589-4456d2426e9b tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:36.594255 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-ccc80ce8-4700-4234-97cb-676ff4709f71 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fafefcbb62bf4284a8a9da5d6c0a4609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894127095d6445f5a2eafc9906ce5cf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:36.605219 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-ccc80ce8-4700-4234-97cb-676ff4709f71 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] 10.222.0.24 "GET /compute/v2.1/servers/718d3de9-c471-44df-8622-ce92537497bf" status: 200 len: 1314 microversion: 2.1 time: 0.343441 May 19 13:32:36.605951 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 77/171] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:36 2022] GET /compute/v2.1/servers/718d3de9-c471-44df-8622-ce92537497bf => generated 1314 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:32:36.655268 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-dab6ed96-7cde-43b2-b589-4456d2426e9b tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:36.665022 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-dab6ed96-7cde-43b2-b589-4456d2426e9b tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a" status: 200 len: 1522 microversion: 2.1 time: 0.244895 May 19 13:32:36.666300 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 95/172] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:36 2022] GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a => generated 1522 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:32:37.622809 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-1d9ab977-59e0-4367-be40-e6456417ff10 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:37.623941 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-1d9ab977-59e0-4367-be40-e6456417ff10 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] [instance: 718d3de9-c471-44df-8622-ce92537497bf] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:37.632726 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-1d9ab977-59e0-4367-be40-e6456417ff10 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:37.633201 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-1d9ab977-59e0-4367-be40-e6456417ff10 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:37.634145 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-1d9ab977-59e0-4367-be40-e6456417ff10 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:37.634743 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-1d9ab977-59e0-4367-be40-e6456417ff10 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:37.683065 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-092ca3c2-4ef8-411f-8763-a84fbdea64a6 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:37.683645 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-092ca3c2-4ef8-411f-8763-a84fbdea64a6 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: bb839e22-971b-4313-be06-20e09838215a] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:37.690150 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-092ca3c2-4ef8-411f-8763-a84fbdea64a6 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:37.690591 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-092ca3c2-4ef8-411f-8763-a84fbdea64a6 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:37.691346 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-092ca3c2-4ef8-411f-8763-a84fbdea64a6 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:37.691769 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-092ca3c2-4ef8-411f-8763-a84fbdea64a6 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:37.843580 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-1d9ab977-59e0-4367-be40-e6456417ff10 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fafefcbb62bf4284a8a9da5d6c0a4609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894127095d6445f5a2eafc9906ce5cf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:37.855102 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-1d9ab977-59e0-4367-be40-e6456417ff10 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] 10.222.0.24 "GET /compute/v2.1/servers/718d3de9-c471-44df-8622-ce92537497bf" status: 200 len: 1464 microversion: 2.1 time: 0.236715 May 19 13:32:37.855857 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 78/173] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:37 2022] GET /compute/v2.1/servers/718d3de9-c471-44df-8622-ce92537497bf => generated 1464 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:32:37.892033 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-092ca3c2-4ef8-411f-8763-a84fbdea64a6 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:37.906266 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-1ab3c63c-3c58-4521-b9f8-5fcd6a9a0255 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:37.906855 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-1ab3c63c-3c58-4521-b9f8-5fcd6a9a0255 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] [instance: 718d3de9-c471-44df-8622-ce92537497bf] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:37.918480 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-092ca3c2-4ef8-411f-8763-a84fbdea64a6 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a" status: 200 len: 1522 microversion: 2.1 time: 0.239186 May 19 13:32:37.919203 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 96/174] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:37 2022] GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a => generated 1522 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:32:37.920167 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-1ab3c63c-3c58-4521-b9f8-5fcd6a9a0255 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:37.920975 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-1ab3c63c-3c58-4521-b9f8-5fcd6a9a0255 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:37.921812 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-1ab3c63c-3c58-4521-b9f8-5fcd6a9a0255 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:37.922587 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-1ab3c63c-3c58-4521-b9f8-5fcd6a9a0255 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:37.959961 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-1ab3c63c-3c58-4521-b9f8-5fcd6a9a0255 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] [instance: 718d3de9-c471-44df-8622-ce92537497bf] Going to try to terminate instance {{(pid=120472) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 13:32:38.148269 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-1ab3c63c-3c58-4521-b9f8-5fcd6a9a0255 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] 10.222.0.24 "DELETE /compute/v2.1/servers/718d3de9-c471-44df-8622-ce92537497bf" status: 204 len: 0 microversion: 2.1 time: 0.246941 May 19 13:32:38.148864 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 79/175] 10.222.0.24 () {58 vars in 1238 bytes} [Thu May 19 13:32:37 2022] DELETE /compute/v2.1/servers/718d3de9-c471-44df-8622-ce92537497bf => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 19 13:32:38.159155 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-9ff859fc-10a6-4190-ba56-35922f2f9b7e tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:38.160254 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-9ff859fc-10a6-4190-ba56-35922f2f9b7e tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] [instance: 718d3de9-c471-44df-8622-ce92537497bf] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:38.173629 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-9ff859fc-10a6-4190-ba56-35922f2f9b7e tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:38.174093 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-9ff859fc-10a6-4190-ba56-35922f2f9b7e tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:38.174874 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-9ff859fc-10a6-4190-ba56-35922f2f9b7e tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:38.175297 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-9ff859fc-10a6-4190-ba56-35922f2f9b7e tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:38.497665 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-9ff859fc-10a6-4190-ba56-35922f2f9b7e tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fafefcbb62bf4284a8a9da5d6c0a4609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894127095d6445f5a2eafc9906ce5cf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:38.506874 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-9ff859fc-10a6-4190-ba56-35922f2f9b7e tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] 10.222.0.24 "GET /compute/v2.1/servers/718d3de9-c471-44df-8622-ce92537497bf" status: 200 len: 1470 microversion: 2.1 time: 0.352633 May 19 13:32:38.508072 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 97/176] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:38 2022] GET /compute/v2.1/servers/718d3de9-c471-44df-8622-ce92537497bf => generated 1470 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:32:38.937605 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-0917d740-c096-4f2e-8436-01607abe62ac tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:38.938848 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-0917d740-c096-4f2e-8436-01607abe62ac tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: bb839e22-971b-4313-be06-20e09838215a] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:38.946490 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-0917d740-c096-4f2e-8436-01607abe62ac tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:38.947274 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-0917d740-c096-4f2e-8436-01607abe62ac tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:38.948225 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-0917d740-c096-4f2e-8436-01607abe62ac tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:38.948889 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-0917d740-c096-4f2e-8436-01607abe62ac tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:39.103929 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-0917d740-c096-4f2e-8436-01607abe62ac tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:39.114552 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-0917d740-c096-4f2e-8436-01607abe62ac tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a" status: 200 len: 1522 microversion: 2.1 time: 0.182688 May 19 13:32:39.115134 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 80/177] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:38 2022] GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:32:39.526126 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-751ef88d-df9b-4b52-b2bc-db54f60e8009 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:39.527446 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-751ef88d-df9b-4b52-b2bc-db54f60e8009 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] [instance: 718d3de9-c471-44df-8622-ce92537497bf] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:39.534356 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-751ef88d-df9b-4b52-b2bc-db54f60e8009 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:39.534868 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-751ef88d-df9b-4b52-b2bc-db54f60e8009 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:39.535662 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-751ef88d-df9b-4b52-b2bc-db54f60e8009 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:39.536086 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-751ef88d-df9b-4b52-b2bc-db54f60e8009 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:39.704755 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-751ef88d-df9b-4b52-b2bc-db54f60e8009 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fafefcbb62bf4284a8a9da5d6c0a4609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894127095d6445f5a2eafc9906ce5cf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:39.715691 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-751ef88d-df9b-4b52-b2bc-db54f60e8009 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] 10.222.0.24 "GET /compute/v2.1/servers/718d3de9-c471-44df-8622-ce92537497bf" status: 200 len: 1470 microversion: 2.1 time: 0.194543 May 19 13:32:39.717332 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 98/178] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:39 2022] GET /compute/v2.1/servers/718d3de9-c471-44df-8622-ce92537497bf => generated 1470 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:32:40.131892 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-a4a35841-ce20-4ffa-9cc0-754a6d697690 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:40.132491 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-a4a35841-ce20-4ffa-9cc0-754a6d697690 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: bb839e22-971b-4313-be06-20e09838215a] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:40.140187 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-a4a35841-ce20-4ffa-9cc0-754a6d697690 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:40.140633 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-a4a35841-ce20-4ffa-9cc0-754a6d697690 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:40.141404 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-a4a35841-ce20-4ffa-9cc0-754a6d697690 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:40.141863 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-a4a35841-ce20-4ffa-9cc0-754a6d697690 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:40.144703 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:32:40.288261 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-a4a35841-ce20-4ffa-9cc0-754a6d697690 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:40.296371 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-a4a35841-ce20-4ffa-9cc0-754a6d697690 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a" status: 200 len: 1522 microversion: 2.1 time: 0.168411 May 19 13:32:40.297036 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 81/179] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:40 2022] GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:32:40.542779 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-f34fcf6f-1f6a-4cfb-b994-4b1b5fb791bf tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1046682869", "imageRef": "9beb860d-9c3f-4244-80aa-71a9c337a429", "flavorRef": "452", "networks": [{"uuid": "3d1b865b-9b95-4b9e-a3a5-0eb7b7719b88"}]}} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:32:40.597988 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.network.neutron [None req-f34fcf6f-1f6a-4cfb-b994-4b1b5fb791bf tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] validate_networks() for [('3d1b865b-9b95-4b9e-a3a5-0eb7b7719b88', None, None, None, None, None)] {{(pid=120471) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 13:32:40.736029 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-9acf17ee-2d4e-4c4d-87e1-6e4dcc83451e tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:40.737063 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-9acf17ee-2d4e-4c4d-87e1-6e4dcc83451e tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] [instance: 718d3de9-c471-44df-8622-ce92537497bf] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:40.745597 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-9acf17ee-2d4e-4c4d-87e1-6e4dcc83451e tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:40.746564 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-9acf17ee-2d4e-4c4d-87e1-6e4dcc83451e tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:40.748136 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-9acf17ee-2d4e-4c4d-87e1-6e4dcc83451e tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:40.749026 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-9acf17ee-2d4e-4c4d-87e1-6e4dcc83451e tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:41.004485 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-9acf17ee-2d4e-4c4d-87e1-6e4dcc83451e tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fafefcbb62bf4284a8a9da5d6c0a4609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894127095d6445f5a2eafc9906ce5cf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:41.014567 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-9acf17ee-2d4e-4c4d-87e1-6e4dcc83451e tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] 10.222.0.24 "GET /compute/v2.1/servers/718d3de9-c471-44df-8622-ce92537497bf" status: 200 len: 1470 microversion: 2.1 time: 0.283951 May 19 13:32:41.015227 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 82/180] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:40 2022] GET /compute/v2.1/servers/718d3de9-c471-44df-8622-ce92537497bf => generated 1470 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:32:41.314844 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-5466d44d-d28e-4e1c-8f44-47596439a503 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:41.315473 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-5466d44d-d28e-4e1c-8f44-47596439a503 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: bb839e22-971b-4313-be06-20e09838215a] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:41.327063 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-5466d44d-d28e-4e1c-8f44-47596439a503 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:41.329545 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-5466d44d-d28e-4e1c-8f44-47596439a503 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:41.330434 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-5466d44d-d28e-4e1c-8f44-47596439a503 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:41.336119 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-5466d44d-d28e-4e1c-8f44-47596439a503 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:41.419422 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.virt.hardware [None req-f34fcf6f-1f6a-4cfb-b994-4b1b5fb791bf tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Flavor limits 0:0:0 {{(pid=120471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 13:32:41.419846 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.virt.hardware [None req-f34fcf6f-1f6a-4cfb-b994-4b1b5fb791bf tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Image limits 0:0:0 {{(pid=120471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 13:32:41.420545 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.virt.hardware [None req-f34fcf6f-1f6a-4cfb-b994-4b1b5fb791bf tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Flavor pref 0:0:0 {{(pid=120471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 13:32:41.421261 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.virt.hardware [None req-f34fcf6f-1f6a-4cfb-b994-4b1b5fb791bf tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Image pref 0:0:0 {{(pid=120471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 13:32:41.421899 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.virt.hardware [None req-f34fcf6f-1f6a-4cfb-b994-4b1b5fb791bf tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 13:32:41.431100 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-f34fcf6f-1f6a-4cfb-b994-4b1b5fb791bf tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:41.431794 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-f34fcf6f-1f6a-4cfb-b994-4b1b5fb791bf tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:41.432763 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-f34fcf6f-1f6a-4cfb-b994-4b1b5fb791bf tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:41.433361 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-f34fcf6f-1f6a-4cfb-b994-4b1b5fb791bf tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:41.452314 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.quota [None req-f34fcf6f-1f6a-4cfb-b994-4b1b5fb791bf tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Getting quotas for project 5a26987661f54291b3cf7086b0a1c98c. Resources: {'instances', 'cores', 'ram'} {{(pid=120471) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 13:32:41.456989 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.quota [None req-f34fcf6f-1f6a-4cfb-b994-4b1b5fb791bf tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Getting quotas for user d9a8a480afb3438cb269ebd710c78018 and project 5a26987661f54291b3cf7086b0a1c98c. Resources: {'instances', 'cores', 'ram'} {{(pid=120471) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 13:32:41.472537 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-f34fcf6f-1f6a-4cfb-b994-4b1b5fb791bf tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Going to run 1 instances... {{(pid=120471) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 13:32:41.475838 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-f34fcf6f-1f6a-4cfb-b994-4b1b5fb791bf tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] [instance: 383e7076-b435-4ecd-81d1-d7154800cab0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9beb860d-9c3f-4244-80aa-71a9c337a429',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120471) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 13:32:41.538117 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-f34fcf6f-1f6a-4cfb-b994-4b1b5fb791bf tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.999526 May 19 13:32:41.539075 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 99/181] 10.222.0.24 () {60 vars in 1146 bytes} [Thu May 19 13:32:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1001 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 19 13:32:41.550631 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-ee89a380-1419-4ce5-952c-54547b921cb4 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:41.551803 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-ee89a380-1419-4ce5-952c-54547b921cb4 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] [instance: 383e7076-b435-4ecd-81d1-d7154800cab0] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:41.624151 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-ee89a380-1419-4ce5-952c-54547b921cb4 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a8a480afb3438cb269ebd710c78018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26987661f54291b3cf7086b0a1c98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:41.633326 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-ee89a380-1419-4ce5-952c-54547b921cb4 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] 10.222.0.24 "GET /compute/v2.1/servers/383e7076-b435-4ecd-81d1-d7154800cab0" status: 200 len: 1214 microversion: 2.1 time: 0.087339 May 19 13:32:41.634288 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 100/182] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:41 2022] GET /compute/v2.1/servers/383e7076-b435-4ecd-81d1-d7154800cab0 => generated 1214 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:32:41.689499 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-5466d44d-d28e-4e1c-8f44-47596439a503 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:41.698494 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-5466d44d-d28e-4e1c-8f44-47596439a503 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a" status: 200 len: 1522 microversion: 2.1 time: 0.388588 May 19 13:32:41.699045 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 83/183] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:41 2022] GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a => generated 1522 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:32:42.031713 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-13f93b40-03f8-4b8c-a9eb-2c111b1b1cfe tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:42.032607 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-13f93b40-03f8-4b8c-a9eb-2c111b1b1cfe tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] [instance: 718d3de9-c471-44df-8622-ce92537497bf] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:42.040084 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-13f93b40-03f8-4b8c-a9eb-2c111b1b1cfe tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:42.053212 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-13f93b40-03f8-4b8c-a9eb-2c111b1b1cfe tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:42.054084 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-13f93b40-03f8-4b8c-a9eb-2c111b1b1cfe tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:42.054516 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-13f93b40-03f8-4b8c-a9eb-2c111b1b1cfe tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:42.135944 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-13f93b40-03f8-4b8c-a9eb-2c111b1b1cfe tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fafefcbb62bf4284a8a9da5d6c0a4609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894127095d6445f5a2eafc9906ce5cf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:42.154903 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-13f93b40-03f8-4b8c-a9eb-2c111b1b1cfe tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] 10.222.0.24 "GET /compute/v2.1/servers/718d3de9-c471-44df-8622-ce92537497bf" status: 200 len: 1428 microversion: 2.1 time: 0.127156 May 19 13:32:42.155612 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 101/184] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:42 2022] GET /compute/v2.1/servers/718d3de9-c471-44df-8622-ce92537497bf => generated 1428 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:32:42.200451 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [req-f70f3065-3543-4657-ba0a-4e5e1d424739 req-e3a17590-5bd1-4430-9ac0-b91859a80ce8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "718d3de9-c471-44df-8622-ce92537497bf", "name": "network-vif-deleted", "tag": "dbe4a516-99f2-45f8-9ab5-3ed1503a5ea7"}]} {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:32:42.211274 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [req-f70f3065-3543-4657-ba0a-4e5e1d424739 req-e3a17590-5bd1-4430-9ac0-b91859a80ce8 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:42.212638 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [req-f70f3065-3543-4657-ba0a-4e5e1d424739 req-e3a17590-5bd1-4430-9ac0-b91859a80ce8 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:42.226140 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.compute.server_external_events [req-f70f3065-3543-4657-ba0a-4e5e1d424739 req-e3a17590-5bd1-4430-9ac0-b91859a80ce8 service nova] Creating event network-vif-deleted:dbe4a516-99f2-45f8-9ab5-3ed1503a5ea7 for instance 718d3de9-c471-44df-8622-ce92537497bf on hv-cinder-84112 May 19 13:32:42.232774 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [req-f70f3065-3543-4657-ba0a-4e5e1d424739 req-e3a17590-5bd1-4430-9ac0-b91859a80ce8 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036036 May 19 13:32:42.233634 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 84/185] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:32:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:32:42.651758 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-32849c49-b01c-4bbe-87fb-9dbfbaa724d0 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:42.652942 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-32849c49-b01c-4bbe-87fb-9dbfbaa724d0 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] [instance: 383e7076-b435-4ecd-81d1-d7154800cab0] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:42.662035 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-32849c49-b01c-4bbe-87fb-9dbfbaa724d0 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:42.662684 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-32849c49-b01c-4bbe-87fb-9dbfbaa724d0 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:42.663596 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-32849c49-b01c-4bbe-87fb-9dbfbaa724d0 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:42.664176 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-32849c49-b01c-4bbe-87fb-9dbfbaa724d0 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:42.717674 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-33b5001a-1c7b-4cfd-94bd-e146e8e8e810 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:42.719120 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-33b5001a-1c7b-4cfd-94bd-e146e8e8e810 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: bb839e22-971b-4313-be06-20e09838215a] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:42.725873 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-33b5001a-1c7b-4cfd-94bd-e146e8e8e810 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:42.726607 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-33b5001a-1c7b-4cfd-94bd-e146e8e8e810 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:42.727608 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-33b5001a-1c7b-4cfd-94bd-e146e8e8e810 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:42.728339 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-33b5001a-1c7b-4cfd-94bd-e146e8e8e810 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:42.731225 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-32849c49-b01c-4bbe-87fb-9dbfbaa724d0 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a8a480afb3438cb269ebd710c78018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26987661f54291b3cf7086b0a1c98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:42.740240 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-32849c49-b01c-4bbe-87fb-9dbfbaa724d0 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] 10.222.0.24 "GET /compute/v2.1/servers/383e7076-b435-4ecd-81d1-d7154800cab0" status: 200 len: 1218 microversion: 2.1 time: 0.093150 May 19 13:32:42.740808 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 102/186] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:42 2022] GET /compute/v2.1/servers/383e7076-b435-4ecd-81d1-d7154800cab0 => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:32:43.172925 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-4c831b5e-ad7d-4bcf-be4f-465c67cbf25e tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:43.173642 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-4c831b5e-ad7d-4bcf-be4f-465c67cbf25e tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] [instance: 718d3de9-c471-44df-8622-ce92537497bf] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:43.179795 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-4c831b5e-ad7d-4bcf-be4f-465c67cbf25e tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:43.180414 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-4c831b5e-ad7d-4bcf-be4f-465c67cbf25e tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:43.181113 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-33b5001a-1c7b-4cfd-94bd-e146e8e8e810 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:43.181363 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-4c831b5e-ad7d-4bcf-be4f-465c67cbf25e tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:43.181815 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-4c831b5e-ad7d-4bcf-be4f-465c67cbf25e tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:43.190757 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-33b5001a-1c7b-4cfd-94bd-e146e8e8e810 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a" status: 200 len: 1522 microversion: 2.1 time: 0.477940 May 19 13:32:43.192204 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 85/187] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:42 2022] GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a => generated 1522 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:32:43.261538 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-4c831b5e-ad7d-4bcf-be4f-465c67cbf25e tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fafefcbb62bf4284a8a9da5d6c0a4609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894127095d6445f5a2eafc9906ce5cf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:43.276386 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-4c831b5e-ad7d-4bcf-be4f-465c67cbf25e tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] 10.222.0.24 "GET /compute/v2.1/servers/718d3de9-c471-44df-8622-ce92537497bf" status: 200 len: 1428 microversion: 2.1 time: 0.107285 May 19 13:32:43.287268 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 103/188] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:43 2022] GET /compute/v2.1/servers/718d3de9-c471-44df-8622-ce92537497bf => generated 1428 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:32:43.764121 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-2b08ff80-004e-47fd-932d-dda4f570d392 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:43.768578 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-2b08ff80-004e-47fd-932d-dda4f570d392 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] [instance: 383e7076-b435-4ecd-81d1-d7154800cab0] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:43.784909 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-2b08ff80-004e-47fd-932d-dda4f570d392 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:43.785555 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-2b08ff80-004e-47fd-932d-dda4f570d392 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:43.787120 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-2b08ff80-004e-47fd-932d-dda4f570d392 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:43.793330 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-2b08ff80-004e-47fd-932d-dda4f570d392 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:43.896621 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-2b08ff80-004e-47fd-932d-dda4f570d392 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a8a480afb3438cb269ebd710c78018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26987661f54291b3cf7086b0a1c98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:43.905795 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-2b08ff80-004e-47fd-932d-dda4f570d392 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] 10.222.0.24 "GET /compute/v2.1/servers/383e7076-b435-4ecd-81d1-d7154800cab0" status: 200 len: 1266 microversion: 2.1 time: 0.149431 May 19 13:32:43.906383 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 86/189] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:43 2022] GET /compute/v2.1/servers/383e7076-b435-4ecd-81d1-d7154800cab0 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:32:44.210964 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-06b17e88-0f94-43f7-bc0e-3e3a1285d97b tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:44.213008 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-06b17e88-0f94-43f7-bc0e-3e3a1285d97b tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: bb839e22-971b-4313-be06-20e09838215a] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:44.231062 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-06b17e88-0f94-43f7-bc0e-3e3a1285d97b tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:44.232489 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-06b17e88-0f94-43f7-bc0e-3e3a1285d97b tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:44.233461 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-06b17e88-0f94-43f7-bc0e-3e3a1285d97b tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:44.234053 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-06b17e88-0f94-43f7-bc0e-3e3a1285d97b tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:44.297092 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-862e388a-79ee-4436-a89b-91484e659126 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:44.297868 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-862e388a-79ee-4436-a89b-91484e659126 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] [instance: 718d3de9-c471-44df-8622-ce92537497bf] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:44.328670 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-862e388a-79ee-4436-a89b-91484e659126 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:44.329219 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-862e388a-79ee-4436-a89b-91484e659126 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:44.332748 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-862e388a-79ee-4436-a89b-91484e659126 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:44.335331 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-862e388a-79ee-4436-a89b-91484e659126 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:44.399089 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-862e388a-79ee-4436-a89b-91484e659126 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:44.399634 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-862e388a-79ee-4436-a89b-91484e659126 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:44.400197 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.objects.instance [None req-862e388a-79ee-4436-a89b-91484e659126 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lazy-loading 'fault' on Instance uuid 718d3de9-c471-44df-8622-ce92537497bf {{(pid=120472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 13:32:44.476574 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-06b17e88-0f94-43f7-bc0e-3e3a1285d97b tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:44.479748 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-862e388a-79ee-4436-a89b-91484e659126 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fafefcbb62bf4284a8a9da5d6c0a4609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894127095d6445f5a2eafc9906ce5cf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:44.494316 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-862e388a-79ee-4436-a89b-91484e659126 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] 10.222.0.24 "GET /compute/v2.1/servers/718d3de9-c471-44df-8622-ce92537497bf" status: 200 len: 1304 microversion: 2.1 time: 0.203381 May 19 13:32:44.494581 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-06b17e88-0f94-43f7-bc0e-3e3a1285d97b tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a" status: 200 len: 1522 microversion: 2.1 time: 0.289877 May 19 13:32:44.495168 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 87/190] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:44 2022] GET /compute/v2.1/servers/718d3de9-c471-44df-8622-ce92537497bf => generated 1304 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:32:44.495538 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 104/191] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:44 2022] GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a => generated 1522 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:32:44.926529 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-fba03717-ca57-40d2-acbf-7cd8258ccc6e tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:44.927165 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-fba03717-ca57-40d2-acbf-7cd8258ccc6e tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] [instance: 383e7076-b435-4ecd-81d1-d7154800cab0] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:44.946992 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-fba03717-ca57-40d2-acbf-7cd8258ccc6e tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:44.946992 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-fba03717-ca57-40d2-acbf-7cd8258ccc6e tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:44.946992 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-fba03717-ca57-40d2-acbf-7cd8258ccc6e tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:44.947250 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-fba03717-ca57-40d2-acbf-7cd8258ccc6e tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:45.077252 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-fba03717-ca57-40d2-acbf-7cd8258ccc6e tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a8a480afb3438cb269ebd710c78018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26987661f54291b3cf7086b0a1c98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:45.093306 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-fba03717-ca57-40d2-acbf-7cd8258ccc6e tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] 10.222.0.24 "GET /compute/v2.1/servers/383e7076-b435-4ecd-81d1-d7154800cab0" status: 200 len: 1266 microversion: 2.1 time: 0.170569 May 19 13:32:45.095053 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 88/192] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:44 2022] GET /compute/v2.1/servers/383e7076-b435-4ecd-81d1-d7154800cab0 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:32:45.515018 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-e465ee2b-b32c-462a-9dc3-f567c3bcd271 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:45.515998 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-e465ee2b-b32c-462a-9dc3-f567c3bcd271 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: bb839e22-971b-4313-be06-20e09838215a] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:45.519476 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-5ea37673-a918-417f-b080-31c28812cdb0 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:45.520426 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-5ea37673-a918-417f-b080-31c28812cdb0 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] [instance: 718d3de9-c471-44df-8622-ce92537497bf] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:45.524340 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-e465ee2b-b32c-462a-9dc3-f567c3bcd271 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:45.525226 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-e465ee2b-b32c-462a-9dc3-f567c3bcd271 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:45.526361 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-e465ee2b-b32c-462a-9dc3-f567c3bcd271 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:45.527053 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-e465ee2b-b32c-462a-9dc3-f567c3bcd271 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:45.556343 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-5ea37673-a918-417f-b080-31c28812cdb0 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:45.556914 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-5ea37673-a918-417f-b080-31c28812cdb0 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:45.559279 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-5ea37673-a918-417f-b080-31c28812cdb0 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:45.560954 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-5ea37673-a918-417f-b080-31c28812cdb0 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:45.574165 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_cell1:SELECT=100 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:32:45.596418 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.wsgi [None req-5ea37673-a918-417f-b080-31c28812cdb0 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] HTTP exception thrown: Instance 718d3de9-c471-44df-8622-ce92537497bf could not be found. May 19 13:32:45.599435 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-5ea37673-a918-417f-b080-31c28812cdb0 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Request method failure captured: May 19 13:32:45.599435 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: request: GET /compute/v2.1/servers/718d3de9-c471-44df-8622-ce92537497bf HTTP/1.1 May 19 13:32:45.599435 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Accept: application/json May 19 13:32:45.599435 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Accept-Encoding: identity May 19 13:32:45.599435 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Connection: close May 19 13:32:45.599435 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Content-Length: 0 May 19 13:32:45.599435 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Content-Type: application/json May 19 13:32:45.599435 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Host: 10.222.0.24 May 19 13:32:45.599435 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Openstack-System-Scope: None May 19 13:32:45.599435 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: User-Agent: python-urllib3/1.26.9 May 19 13:32:45.599435 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Auth-Token: gAAAAABihkbcm8cc9h-Yu5DsI5DTmnBsNiaWdY8PdMx9I5VHyqaqH1RG9kTtMGfd34RXRNzQxRdf1jgHoiQ6tycmjiIezK9BzJoT8rFCCawbQifk2XjrEAR6lXcxd0RL2615sgQ2i5MrlfF3SDZZ6oJ-m1It22QEYh8rZDngGckd6jCjVzBY5AE May 19 13:32:45.599435 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Domain-Id: None May 19 13:32:45.599435 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Domain-Name: None May 19 13:32:45.599435 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Identity-Status: Confirmed May 19 13:32:45.599435 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Is-Admin-Project: True May 19 13:32:45.599435 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Domain-Id: default May 19 13:32:45.599435 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Domain-Name: Default May 19 13:32:45.599435 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Id: 894127095d6445f5a2eafc9906ce5cf7 May 19 13:32:45.599435 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Name: tempest-VolumesNegativeTest-213210640 May 19 13:32:45.599435 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Role: reader,member May 19 13:32:45.599435 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Roles: reader,member May 19 13:32:45.600909 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/894127095d6445f5a2eafc9906ce5cf7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/894127095d6445f5a2eafc9906ce5cf7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_894127095d6445f5a2eafc9906ce5cf7", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/894127095d6445f5a2eafc9906ce5cf7"}]}] May 19 13:32:45.600909 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Tenant: tempest-VolumesNegativeTest-213210640 May 19 13:32:45.600909 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Tenant-Id: 894127095d6445f5a2eafc9906ce5cf7 May 19 13:32:45.600909 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Tenant-Name: tempest-VolumesNegativeTest-213210640 May 19 13:32:45.600909 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User: tempest-VolumesNegativeTest-213210640-project May 19 13:32:45.600909 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Domain-Id: default May 19 13:32:45.600909 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Domain-Name: Default May 19 13:32:45.600909 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Id: fafefcbb62bf4284a8a9da5d6c0a4609 May 19 13:32:45.600909 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Name: tempest-VolumesNegativeTest-213210640-project May 19 13:32:45.600909 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: method: > May 19 13:32:45.600909 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: exception: Instance 718d3de9-c471-44df-8622-ce92537497bf could not be found. May 19 13:32:45.600909 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: action_args: {'id': '718d3de9-c471-44df-8622-ce92537497bf'} May 19 13:32:45.601808 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:32:45.601808 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:32:45.601808 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 13:32:45.601808 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 13:32:45.601808 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 13:32:45.601808 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 13:32:45.601808 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 13:32:45.601808 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 13:32:45.601808 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 13:32:45.601808 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 13:32:45.601808 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 718d3de9-c471-44df-8622-ce92537497bf could not be found. May 19 13:32:45.601808 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:32:45.601808 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:32:45.601808 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:32:45.601808 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:32:45.601808 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:32:45.601808 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:32:45.601808 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:32:45.601808 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:32:45.601808 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:32:45.603892 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:32:45.603892 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 13:32:45.603892 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 13:32:45.603892 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 13:32:45.603892 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 13:32:45.603892 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 13:32:45.603892 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 13:32:45.603892 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 718d3de9-c471-44df-8622-ce92537497bf could not be found. May 19 13:32:45.603892 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:32:45.603892 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:32:45.603892 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:32:45.603892 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:32:45.603892 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:32:45.603892 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:32:45.603892 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:32:45.603892 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:32:45.603892 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 718d3de9-c471-44df-8622-ce92537497bf could not be found. May 19 13:32:45.603892 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:32:45.605089 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-5ea37673-a918-417f-b080-31c28812cdb0 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] Returning 404 to user: Instance 718d3de9-c471-44df-8622-ce92537497bf could not be found. {{(pid=120471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:32:45.607628 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-5ea37673-a918-417f-b080-31c28812cdb0 tempest-VolumesNegativeTest-213210640 tempest-VolumesNegativeTest-213210640-project] 10.222.0.24 "GET /compute/v2.1/servers/718d3de9-c471-44df-8622-ce92537497bf" status: 404 len: 111 microversion: 2.1 time: 0.098835 May 19 13:32:45.608301 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 105/193] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:45 2022] GET /compute/v2.1/servers/718d3de9-c471-44df-8622-ce92537497bf => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 13:32:46.112361 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-dabb867c-d5a5-4095-a270-d1669b9524cb tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:46.113830 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-dabb867c-d5a5-4095-a270-d1669b9524cb tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] [instance: 383e7076-b435-4ecd-81d1-d7154800cab0] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:46.122769 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-dabb867c-d5a5-4095-a270-d1669b9524cb tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:46.123943 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-dabb867c-d5a5-4095-a270-d1669b9524cb tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:46.124958 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-dabb867c-d5a5-4095-a270-d1669b9524cb tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:46.125641 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-dabb867c-d5a5-4095-a270-d1669b9524cb tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:46.203257 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-e465ee2b-b32c-462a-9dc3-f567c3bcd271 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:46.213448 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-e465ee2b-b32c-462a-9dc3-f567c3bcd271 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a" status: 200 len: 1522 microversion: 2.1 time: 0.701477 May 19 13:32:46.215527 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-dabb867c-d5a5-4095-a270-d1669b9524cb tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a8a480afb3438cb269ebd710c78018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26987661f54291b3cf7086b0a1c98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:46.236381 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 89/194] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:45 2022] GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a => generated 1522 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:32:46.250734 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-dabb867c-d5a5-4095-a270-d1669b9524cb tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] 10.222.0.24 "GET /compute/v2.1/servers/383e7076-b435-4ecd-81d1-d7154800cab0" status: 200 len: 1272 microversion: 2.1 time: 0.140270 May 19 13:32:46.265821 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 106/195] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:46 2022] GET /compute/v2.1/servers/383e7076-b435-4ecd-81d1-d7154800cab0 => generated 1272 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:32:47.232557 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-68565558-2de4-47ec-ab29-412e406ed999 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:47.233161 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-68565558-2de4-47ec-ab29-412e406ed999 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: bb839e22-971b-4313-be06-20e09838215a] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:47.248053 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-68565558-2de4-47ec-ab29-412e406ed999 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:47.248501 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-68565558-2de4-47ec-ab29-412e406ed999 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:47.249275 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-68565558-2de4-47ec-ab29-412e406ed999 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:47.249741 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-68565558-2de4-47ec-ab29-412e406ed999 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:47.273578 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-d2fefa74-f2fe-4d9d-a96e-c37defc62955 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:47.274322 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-d2fefa74-f2fe-4d9d-a96e-c37defc62955 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] [instance: 383e7076-b435-4ecd-81d1-d7154800cab0] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:47.283200 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-d2fefa74-f2fe-4d9d-a96e-c37defc62955 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:47.284054 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-d2fefa74-f2fe-4d9d-a96e-c37defc62955 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:47.285038 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-d2fefa74-f2fe-4d9d-a96e-c37defc62955 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:47.286724 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-d2fefa74-f2fe-4d9d-a96e-c37defc62955 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:47.385753 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-d2fefa74-f2fe-4d9d-a96e-c37defc62955 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a8a480afb3438cb269ebd710c78018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26987661f54291b3cf7086b0a1c98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:47.395697 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-d2fefa74-f2fe-4d9d-a96e-c37defc62955 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] 10.222.0.24 "GET /compute/v2.1/servers/383e7076-b435-4ecd-81d1-d7154800cab0" status: 200 len: 1272 microversion: 2.1 time: 0.129769 May 19 13:32:47.396264 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 107/196] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:47 2022] GET /compute/v2.1/servers/383e7076-b435-4ecd-81d1-d7154800cab0 => generated 1272 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:32:47.649855 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-68565558-2de4-47ec-ab29-412e406ed999 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:47.679846 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-68565558-2de4-47ec-ab29-412e406ed999 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a" status: 200 len: 1522 microversion: 2.1 time: 0.432284 May 19 13:32:47.680518 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 90/197] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:47 2022] GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a => generated 1522 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:32:48.417042 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-b543c941-218b-4e30-9cb7-9ba855b0c481 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:48.419218 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-b543c941-218b-4e30-9cb7-9ba855b0c481 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] [instance: 383e7076-b435-4ecd-81d1-d7154800cab0] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:48.433917 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-b543c941-218b-4e30-9cb7-9ba855b0c481 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:48.434693 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-b543c941-218b-4e30-9cb7-9ba855b0c481 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:48.436743 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-b543c941-218b-4e30-9cb7-9ba855b0c481 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:48.437246 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-b543c941-218b-4e30-9cb7-9ba855b0c481 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:48.681842 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-b543c941-218b-4e30-9cb7-9ba855b0c481 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a8a480afb3438cb269ebd710c78018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26987661f54291b3cf7086b0a1c98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:48.689650 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-b543c941-218b-4e30-9cb7-9ba855b0c481 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] 10.222.0.24 "GET /compute/v2.1/servers/383e7076-b435-4ecd-81d1-d7154800cab0" status: 200 len: 1314 microversion: 2.1 time: 0.277984 May 19 13:32:48.696642 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-1e282893-739d-4085-876d-f7442c7b42b3 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:48.697250 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-1e282893-739d-4085-876d-f7442c7b42b3 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: bb839e22-971b-4313-be06-20e09838215a] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:48.701165 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:32:48.703686 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 108/198] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:48 2022] GET /compute/v2.1/servers/383e7076-b435-4ecd-81d1-d7154800cab0 => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:32:48.714535 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-1e282893-739d-4085-876d-f7442c7b42b3 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:48.714977 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-1e282893-739d-4085-876d-f7442c7b42b3 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:48.716120 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-1e282893-739d-4085-876d-f7442c7b42b3 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:48.716705 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-1e282893-739d-4085-876d-f7442c7b42b3 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:48.949831 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-1e282893-739d-4085-876d-f7442c7b42b3 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:48.964451 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-1e282893-739d-4085-876d-f7442c7b42b3 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a" status: 200 len: 1502 microversion: 2.1 time: 0.269932 May 19 13:32:48.970428 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 91/199] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:48 2022] GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a => generated 1502 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:32:48.983515 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-b519cb72-6d67-4261-98f9-0a7a34f46b57 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:48.984063 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-b519cb72-6d67-4261-98f9-0a7a34f46b57 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: c4c1abc9-8651-4788-9650-27704ae7e306] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:48.999322 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-b519cb72-6d67-4261-98f9-0a7a34f46b57 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:48.999863 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-b519cb72-6d67-4261-98f9-0a7a34f46b57 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:49.000681 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-b519cb72-6d67-4261-98f9-0a7a34f46b57 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:49.001113 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-b519cb72-6d67-4261-98f9-0a7a34f46b57 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:49.202721 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-b519cb72-6d67-4261-98f9-0a7a34f46b57 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:49.213542 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-b519cb72-6d67-4261-98f9-0a7a34f46b57 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306" status: 200 len: 1514 microversion: 2.1 time: 0.235939 May 19 13:32:49.214296 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 109/200] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:48 2022] GET /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306 => generated 1514 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:32:49.723076 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-1e8a8e95-caf4-49b2-89cd-f8301247c19d tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:49.724837 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-1e8a8e95-caf4-49b2-89cd-f8301247c19d tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] [instance: 383e7076-b435-4ecd-81d1-d7154800cab0] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:49.732566 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [req-560feb8b-c526-4805-9f41-991372121f92 req-b7dce86b-a93f-48f0-a23a-8cc6b87041b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "383e7076-b435-4ecd-81d1-d7154800cab0", "tag": "de61cd08-bee3-42ae-b8ef-49a50a8b7e3c"}]} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:32:49.742907 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:32:49.753196 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-1e8a8e95-caf4-49b2-89cd-f8301247c19d tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:49.758103 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-1e8a8e95-caf4-49b2-89cd-f8301247c19d tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:49.759916 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-1e8a8e95-caf4-49b2-89cd-f8301247c19d tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:49.762195 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-1e8a8e95-caf4-49b2-89cd-f8301247c19d tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:49.772888 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-560feb8b-c526-4805-9f41-991372121f92 req-b7dce86b-a93f-48f0-a23a-8cc6b87041b7 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:49.775717 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-560feb8b-c526-4805-9f41-991372121f92 req-b7dce86b-a93f-48f0-a23a-8cc6b87041b7 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:49.834993 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.compute.server_external_events [req-560feb8b-c526-4805-9f41-991372121f92 req-b7dce86b-a93f-48f0-a23a-8cc6b87041b7 service nova] Creating event network-changed:de61cd08-bee3-42ae-b8ef-49a50a8b7e3c for instance 383e7076-b435-4ecd-81d1-d7154800cab0 on hv-cinder-84112 May 19 13:32:49.859005 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [req-560feb8b-c526-4805-9f41-991372121f92 req-b7dce86b-a93f-48f0-a23a-8cc6b87041b7 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131509 May 19 13:32:49.859741 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 110/201] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:32:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 13:32:50.219565 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-1e8a8e95-caf4-49b2-89cd-f8301247c19d tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a8a480afb3438cb269ebd710c78018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26987661f54291b3cf7086b0a1c98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:50.238302 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-1e8a8e95-caf4-49b2-89cd-f8301247c19d tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] 10.222.0.24 "GET /compute/v2.1/servers/383e7076-b435-4ecd-81d1-d7154800cab0" status: 200 len: 1314 microversion: 2.1 time: 0.520695 May 19 13:32:50.239043 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 92/202] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:49 2022] GET /compute/v2.1/servers/383e7076-b435-4ecd-81d1-d7154800cab0 => generated 1314 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:32:50.941181 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-22dd0324-6466-488b-98a9-cd094d1fd36f tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:32:50.942390 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-22dd0324-6466-488b-98a9-cd094d1fd36f tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: c4c1abc9-8651-4788-9650-27704ae7e306] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:50.963725 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-22dd0324-6466-488b-98a9-cd094d1fd36f tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:50.969055 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-22dd0324-6466-488b-98a9-cd094d1fd36f tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:50.970118 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-22dd0324-6466-488b-98a9-cd094d1fd36f tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:50.970579 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-22dd0324-6466-488b-98a9-cd094d1fd36f tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:51.032509 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.objects.instance [None req-22dd0324-6466-488b-98a9-cd094d1fd36f tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lazy-loading 'flavor' on Instance uuid c4c1abc9-8651-4788-9650-27704ae7e306 {{(pid=120471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 13:32:51.243880 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-22dd0324-6466-488b-98a9-cd094d1fd36f tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "POST /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306/action" status: 200 len: 32 microversion: 2.1 time: 0.311889 May 19 13:32:51.247565 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 111/203] 10.222.0.24 () {60 vars in 1277 bytes} [Thu May 19 13:32:50 2022] POST /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306/action => generated 32 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 13:32:51.255843 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-fd9f8639-99e3-49fa-9fc9-dc8aded7bbfe tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:51.257170 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-fd9f8639-99e3-49fa-9fc9-dc8aded7bbfe tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: c4c1abc9-8651-4788-9650-27704ae7e306] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:51.272187 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-fd9f8639-99e3-49fa-9fc9-dc8aded7bbfe tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:51.272784 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-c53fe58b-6d34-49b1-b15a-d724bb3c9d89 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:51.273792 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-fd9f8639-99e3-49fa-9fc9-dc8aded7bbfe tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:51.274433 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-c53fe58b-6d34-49b1-b15a-d724bb3c9d89 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] [instance: 383e7076-b435-4ecd-81d1-d7154800cab0] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:51.277111 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-fd9f8639-99e3-49fa-9fc9-dc8aded7bbfe tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:51.277716 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-fd9f8639-99e3-49fa-9fc9-dc8aded7bbfe tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:51.295265 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-c53fe58b-6d34-49b1-b15a-d724bb3c9d89 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:51.298172 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-c53fe58b-6d34-49b1-b15a-d724bb3c9d89 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:51.299471 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-c53fe58b-6d34-49b1-b15a-d724bb3c9d89 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:51.299996 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-c53fe58b-6d34-49b1-b15a-d724bb3c9d89 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:51.449441 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_cell0:SELECT=2 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:32:51.575321 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-fd9f8639-99e3-49fa-9fc9-dc8aded7bbfe tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:51.586651 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-fd9f8639-99e3-49fa-9fc9-dc8aded7bbfe tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306" status: 200 len: 1520 microversion: 2.1 time: 0.334879 May 19 13:32:51.587788 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 93/204] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:51 2022] GET /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306 => generated 1520 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:32:51.633620 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_cell0:SELECT=8 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:32:51.774788 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-c53fe58b-6d34-49b1-b15a-d724bb3c9d89 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a8a480afb3438cb269ebd710c78018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26987661f54291b3cf7086b0a1c98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:51.786256 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-c53fe58b-6d34-49b1-b15a-d724bb3c9d89 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] 10.222.0.24 "GET /compute/v2.1/servers/383e7076-b435-4ecd-81d1-d7154800cab0" status: 200 len: 1314 microversion: 2.1 time: 0.525736 May 19 13:32:51.787489 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 112/205] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:51 2022] GET /compute/v2.1/servers/383e7076-b435-4ecd-81d1-d7154800cab0 => generated 1314 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:32:52.607484 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-5dc5f192-aa1e-4567-af25-999240951e03 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:52.609018 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-5dc5f192-aa1e-4567-af25-999240951e03 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: c4c1abc9-8651-4788-9650-27704ae7e306] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:52.617327 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-5dc5f192-aa1e-4567-af25-999240951e03 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:52.617999 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-5dc5f192-aa1e-4567-af25-999240951e03 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:52.618886 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-5dc5f192-aa1e-4567-af25-999240951e03 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:52.623577 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-5dc5f192-aa1e-4567-af25-999240951e03 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:52.804453 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-46db542b-d718-45c4-bbb7-8c783b6262a8 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:52.805205 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-46db542b-d718-45c4-bbb7-8c783b6262a8 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] [instance: 383e7076-b435-4ecd-81d1-d7154800cab0] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:52.814957 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-46db542b-d718-45c4-bbb7-8c783b6262a8 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:52.816826 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-46db542b-d718-45c4-bbb7-8c783b6262a8 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:52.817686 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-46db542b-d718-45c4-bbb7-8c783b6262a8 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:52.819961 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-46db542b-d718-45c4-bbb7-8c783b6262a8 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:53.865844 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-46db542b-d718-45c4-bbb7-8c783b6262a8 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a8a480afb3438cb269ebd710c78018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26987661f54291b3cf7086b0a1c98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:53.879902 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-46db542b-d718-45c4-bbb7-8c783b6262a8 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] 10.222.0.24 "GET /compute/v2.1/servers/383e7076-b435-4ecd-81d1-d7154800cab0" status: 200 len: 1314 microversion: 2.1 time: 1.079552 May 19 13:32:53.891048 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 113/206] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:52 2022] GET /compute/v2.1/servers/383e7076-b435-4ecd-81d1-d7154800cab0 => generated 1314 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:32:54.118411 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-5dc5f192-aa1e-4567-af25-999240951e03 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:54.140546 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-5dc5f192-aa1e-4567-af25-999240951e03 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306" status: 200 len: 1520 microversion: 2.1 time: 1.539685 May 19 13:32:54.147051 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 94/207] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:52 2022] GET /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306 => generated 1520 bytes in 1547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:32:54.897621 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-f2376dec-983d-4f13-9eb1-2057fb1dea77 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:54.898232 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-f2376dec-983d-4f13-9eb1-2057fb1dea77 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] [instance: 383e7076-b435-4ecd-81d1-d7154800cab0] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:54.907097 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-f2376dec-983d-4f13-9eb1-2057fb1dea77 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:54.907536 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-f2376dec-983d-4f13-9eb1-2057fb1dea77 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:54.908293 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-f2376dec-983d-4f13-9eb1-2057fb1dea77 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:54.908718 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-f2376dec-983d-4f13-9eb1-2057fb1dea77 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:55.091163 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-f2376dec-983d-4f13-9eb1-2057fb1dea77 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a8a480afb3438cb269ebd710c78018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26987661f54291b3cf7086b0a1c98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:55.100386 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-f2376dec-983d-4f13-9eb1-2057fb1dea77 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] 10.222.0.24 "GET /compute/v2.1/servers/383e7076-b435-4ecd-81d1-d7154800cab0" status: 200 len: 1314 microversion: 2.1 time: 0.207067 May 19 13:32:55.100961 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 114/208] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:54 2022] GET /compute/v2.1/servers/383e7076-b435-4ecd-81d1-d7154800cab0 => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:32:55.165712 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-a2a39181-040a-44f8-b1ec-fc4d039d435a tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:55.167473 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-a2a39181-040a-44f8-b1ec-fc4d039d435a tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: c4c1abc9-8651-4788-9650-27704ae7e306] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:55.179265 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-a2a39181-040a-44f8-b1ec-fc4d039d435a tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:55.180558 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-a2a39181-040a-44f8-b1ec-fc4d039d435a tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:55.181915 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-a2a39181-040a-44f8-b1ec-fc4d039d435a tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:55.182619 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-a2a39181-040a-44f8-b1ec-fc4d039d435a tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:55.439321 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-a2a39181-040a-44f8-b1ec-fc4d039d435a tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:55.453807 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-a2a39181-040a-44f8-b1ec-fc4d039d435a tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306" status: 200 len: 1520 microversion: 2.1 time: 0.292519 May 19 13:32:55.454402 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 95/209] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:55 2022] GET /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306 => generated 1520 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:32:56.117274 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-5015203e-9089-4c4d-a4e4-964782c4c8ea tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:56.118229 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-5015203e-9089-4c4d-a4e4-964782c4c8ea tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] [instance: 383e7076-b435-4ecd-81d1-d7154800cab0] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:56.125509 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-5015203e-9089-4c4d-a4e4-964782c4c8ea tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:56.126250 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-5015203e-9089-4c4d-a4e4-964782c4c8ea tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:56.127100 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-5015203e-9089-4c4d-a4e4-964782c4c8ea tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:56.127597 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-5015203e-9089-4c4d-a4e4-964782c4c8ea tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:56.279236 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-5015203e-9089-4c4d-a4e4-964782c4c8ea tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a8a480afb3438cb269ebd710c78018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26987661f54291b3cf7086b0a1c98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:56.287300 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-5015203e-9089-4c4d-a4e4-964782c4c8ea tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] 10.222.0.24 "GET /compute/v2.1/servers/383e7076-b435-4ecd-81d1-d7154800cab0" status: 200 len: 1314 microversion: 2.1 time: 0.174245 May 19 13:32:56.287892 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 115/210] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:56 2022] GET /compute/v2.1/servers/383e7076-b435-4ecd-81d1-d7154800cab0 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:32:56.470252 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-f0c312f2-a7d2-4dec-88d9-ca2e03c1286c tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:56.470938 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-f0c312f2-a7d2-4dec-88d9-ca2e03c1286c tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: c4c1abc9-8651-4788-9650-27704ae7e306] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:56.478898 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-f0c312f2-a7d2-4dec-88d9-ca2e03c1286c tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:56.479765 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-f0c312f2-a7d2-4dec-88d9-ca2e03c1286c tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:56.481035 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-f0c312f2-a7d2-4dec-88d9-ca2e03c1286c tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:56.481972 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-f0c312f2-a7d2-4dec-88d9-ca2e03c1286c tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:56.737394 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-f0c312f2-a7d2-4dec-88d9-ca2e03c1286c tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:56.745371 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-f0c312f2-a7d2-4dec-88d9-ca2e03c1286c tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306" status: 200 len: 1520 microversion: 2.1 time: 0.279129 May 19 13:32:56.746404 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 96/211] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:56 2022] GET /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306 => generated 1520 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:32:57.304183 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-14334c14-ff33-4f2a-8cba-660499dcade2 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:57.304788 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-14334c14-ff33-4f2a-8cba-660499dcade2 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] [instance: 383e7076-b435-4ecd-81d1-d7154800cab0] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:57.311169 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-14334c14-ff33-4f2a-8cba-660499dcade2 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:57.311611 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-14334c14-ff33-4f2a-8cba-660499dcade2 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:57.312360 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-14334c14-ff33-4f2a-8cba-660499dcade2 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:57.312785 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-14334c14-ff33-4f2a-8cba-660499dcade2 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:57.470935 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-14334c14-ff33-4f2a-8cba-660499dcade2 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a8a480afb3438cb269ebd710c78018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26987661f54291b3cf7086b0a1c98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:57.480601 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-14334c14-ff33-4f2a-8cba-660499dcade2 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] 10.222.0.24 "GET /compute/v2.1/servers/383e7076-b435-4ecd-81d1-d7154800cab0" status: 200 len: 1314 microversion: 2.1 time: 0.180156 May 19 13:32:57.481162 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 116/212] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:57 2022] GET /compute/v2.1/servers/383e7076-b435-4ecd-81d1-d7154800cab0 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:32:57.764011 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-71be008a-8576-45b3-9efc-5fd8132fdcb7 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:57.765275 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-71be008a-8576-45b3-9efc-5fd8132fdcb7 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: c4c1abc9-8651-4788-9650-27704ae7e306] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:57.779010 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-71be008a-8576-45b3-9efc-5fd8132fdcb7 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:57.779867 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-71be008a-8576-45b3-9efc-5fd8132fdcb7 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:57.780923 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-71be008a-8576-45b3-9efc-5fd8132fdcb7 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:57.784653 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-71be008a-8576-45b3-9efc-5fd8132fdcb7 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:57.999218 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-71be008a-8576-45b3-9efc-5fd8132fdcb7 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:58.008636 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-71be008a-8576-45b3-9efc-5fd8132fdcb7 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306" status: 200 len: 1520 microversion: 2.1 time: 0.249152 May 19 13:32:58.009971 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 97/213] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:57 2022] GET /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306 => generated 1520 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:32:58.498290 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-eef68e4e-e17e-4c0f-8f0b-8b3ca1218eb8 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:58.499624 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-eef68e4e-e17e-4c0f-8f0b-8b3ca1218eb8 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] [instance: 383e7076-b435-4ecd-81d1-d7154800cab0] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:58.506198 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-eef68e4e-e17e-4c0f-8f0b-8b3ca1218eb8 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:58.506846 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-eef68e4e-e17e-4c0f-8f0b-8b3ca1218eb8 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:58.507778 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-eef68e4e-e17e-4c0f-8f0b-8b3ca1218eb8 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:58.508366 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-eef68e4e-e17e-4c0f-8f0b-8b3ca1218eb8 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:58.672241 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-eef68e4e-e17e-4c0f-8f0b-8b3ca1218eb8 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a8a480afb3438cb269ebd710c78018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26987661f54291b3cf7086b0a1c98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:58.681712 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-eef68e4e-e17e-4c0f-8f0b-8b3ca1218eb8 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] 10.222.0.24 "GET /compute/v2.1/servers/383e7076-b435-4ecd-81d1-d7154800cab0" status: 200 len: 1314 microversion: 2.1 time: 0.187905 May 19 13:32:58.682882 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 117/214] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:58 2022] GET /compute/v2.1/servers/383e7076-b435-4ecd-81d1-d7154800cab0 => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:32:59.030467 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-2c8d29a8-449b-4532-bed1-583b828263e4 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:59.032143 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-2c8d29a8-449b-4532-bed1-583b828263e4 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: c4c1abc9-8651-4788-9650-27704ae7e306] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:59.043254 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-2c8d29a8-449b-4532-bed1-583b828263e4 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:59.044782 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-2c8d29a8-449b-4532-bed1-583b828263e4 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:59.049295 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-2c8d29a8-449b-4532-bed1-583b828263e4 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:59.052011 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-2c8d29a8-449b-4532-bed1-583b828263e4 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:59.095070 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_cell1:SELECT=100 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:32:59.254549 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-4de95a15-f0ff-4a2a-88fd-3ee2afba5273 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:59.255043 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-4de95a15-f0ff-4a2a-88fd-3ee2afba5273 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:59.270233 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-4de95a15-f0ff-4a2a-88fd-3ee2afba5273 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:59.270798 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-4de95a15-f0ff-4a2a-88fd-3ee2afba5273 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:59.271661 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-4de95a15-f0ff-4a2a-88fd-3ee2afba5273 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:59.272133 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-4de95a15-f0ff-4a2a-88fd-3ee2afba5273 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:59.342419 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-4de95a15-f0ff-4a2a-88fd-3ee2afba5273 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10/ips" status: 200 len: 152 microversion: 2.20 time: 0.093130 May 19 13:32:59.352009 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 118/215] 10.222.0.24 () {60 vars in 1288 bytes} [Thu May 19 13:32:59 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10/ips => generated 152 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 13:32:59.388418 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-2c8d29a8-449b-4532-bed1-583b828263e4 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:32:59.405031 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-2c8d29a8-449b-4532-bed1-583b828263e4 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306" status: 200 len: 1520 microversion: 2.1 time: 0.381074 May 19 13:32:59.406866 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 98/216] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:59 2022] GET /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306 => generated 1520 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:32:59.700153 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-1ab6a26f-7c06-429c-8417-bbf235fbb4d9 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:32:59.701684 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-1ab6a26f-7c06-429c-8417-bbf235fbb4d9 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] [instance: 383e7076-b435-4ecd-81d1-d7154800cab0] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:32:59.716545 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-1ab6a26f-7c06-429c-8417-bbf235fbb4d9 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:59.724358 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-1ab6a26f-7c06-429c-8417-bbf235fbb4d9 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:32:59.728443 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-1ab6a26f-7c06-429c-8417-bbf235fbb4d9 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:32:59.731537 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-1ab6a26f-7c06-429c-8417-bbf235fbb4d9 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:00.268820 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-1ab6a26f-7c06-429c-8417-bbf235fbb4d9 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a8a480afb3438cb269ebd710c78018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26987661f54291b3cf7086b0a1c98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:00.286429 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-1ab6a26f-7c06-429c-8417-bbf235fbb4d9 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] 10.222.0.24 "GET /compute/v2.1/servers/383e7076-b435-4ecd-81d1-d7154800cab0" status: 200 len: 1314 microversion: 2.1 time: 0.589610 May 19 13:33:00.288275 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 119/217] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:32:59 2022] GET /compute/v2.1/servers/383e7076-b435-4ecd-81d1-d7154800cab0 => generated 1314 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:00.430277 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-b5b11e40-e9e5-4a74-abea-3e7758d9ee96 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:00.431074 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-b5b11e40-e9e5-4a74-abea-3e7758d9ee96 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: c4c1abc9-8651-4788-9650-27704ae7e306] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:00.440364 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [req-b4eb7ca6-563c-4e1d-b580-0d290f9cf730 req-899e13a8-b1de-493e-9250-0ed995a13521 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "383e7076-b435-4ecd-81d1-d7154800cab0", "name": "network-vif-plugged", "status": "completed", "tag": "de61cd08-bee3-42ae-b8ef-49a50a8b7e3c"}]} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:33:00.444509 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-b5b11e40-e9e5-4a74-abea-3e7758d9ee96 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:00.444970 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-b5b11e40-e9e5-4a74-abea-3e7758d9ee96 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:00.447657 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-b5b11e40-e9e5-4a74-abea-3e7758d9ee96 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:00.448376 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-b5b11e40-e9e5-4a74-abea-3e7758d9ee96 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:00.451723 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-b4eb7ca6-563c-4e1d-b580-0d290f9cf730 req-899e13a8-b1de-493e-9250-0ed995a13521 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:00.458116 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-b4eb7ca6-563c-4e1d-b580-0d290f9cf730 req-899e13a8-b1de-493e-9250-0ed995a13521 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:00.475770 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.compute.server_external_events [req-b4eb7ca6-563c-4e1d-b580-0d290f9cf730 req-899e13a8-b1de-493e-9250-0ed995a13521 service nova] Creating event network-vif-plugged:de61cd08-bee3-42ae-b8ef-49a50a8b7e3c for instance 383e7076-b435-4ecd-81d1-d7154800cab0 on hv-cinder-84112 May 19 13:33:00.489566 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [req-b4eb7ca6-563c-4e1d-b580-0d290f9cf730 req-899e13a8-b1de-493e-9250-0ed995a13521 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052942 May 19 13:33:00.490744 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 120/218] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:33:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 13:33:00.886717 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-b5b11e40-e9e5-4a74-abea-3e7758d9ee96 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:00.902918 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-b5b11e40-e9e5-4a74-abea-3e7758d9ee96 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306" status: 200 len: 1520 microversion: 2.1 time: 0.483054 May 19 13:33:00.905240 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 99/219] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:00 2022] GET /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306 => generated 1520 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:33:01.308080 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-e24a325a-f468-4ea5-84f4-b8d187839c02 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:01.308773 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-e24a325a-f468-4ea5-84f4-b8d187839c02 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] [instance: 383e7076-b435-4ecd-81d1-d7154800cab0] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:01.315939 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-e24a325a-f468-4ea5-84f4-b8d187839c02 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:01.319846 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-e24a325a-f468-4ea5-84f4-b8d187839c02 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:01.322232 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-e24a325a-f468-4ea5-84f4-b8d187839c02 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:01.323893 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-e24a325a-f468-4ea5-84f4-b8d187839c02 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:01.717493 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-e24a325a-f468-4ea5-84f4-b8d187839c02 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a8a480afb3438cb269ebd710c78018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26987661f54291b3cf7086b0a1c98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:01.737706 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-e24a325a-f468-4ea5-84f4-b8d187839c02 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] 10.222.0.24 "GET /compute/v2.1/servers/383e7076-b435-4ecd-81d1-d7154800cab0" status: 200 len: 1314 microversion: 2.1 time: 0.426155 May 19 13:33:01.747207 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 121/220] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:01 2022] GET /compute/v2.1/servers/383e7076-b435-4ecd-81d1-d7154800cab0 => generated 1314 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:01.844129 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-252610da-bca6-4ad4-976d-1d556a22f721 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:33:01.845336 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-252610da-bca6-4ad4-976d-1d556a22f721 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:01.861650 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-252610da-bca6-4ad4-976d-1d556a22f721 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:01.865887 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-252610da-bca6-4ad4-976d-1d556a22f721 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:01.866963 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-252610da-bca6-4ad4-976d-1d556a22f721 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:01.869506 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-252610da-bca6-4ad4-976d-1d556a22f721 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:01.923086 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-d959c634-fbff-42cd-8c46-8385c68e1f5c tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:01.923695 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-d959c634-fbff-42cd-8c46-8385c68e1f5c tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: c4c1abc9-8651-4788-9650-27704ae7e306] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:01.947082 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-d959c634-fbff-42cd-8c46-8385c68e1f5c tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:01.951192 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-d959c634-fbff-42cd-8c46-8385c68e1f5c tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:01.961845 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-d959c634-fbff-42cd-8c46-8385c68e1f5c tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:01.962779 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-d959c634-fbff-42cd-8c46-8385c68e1f5c tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:01.978493 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:33:02.007274 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.objects.instance [None req-252610da-bca6-4ad4-976d-1d556a22f721 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lazy-loading 'flavor' on Instance uuid 323322ec-2e2e-424b-a411-8a34069bcf10 {{(pid=120472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 13:33:02.409949 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-d959c634-fbff-42cd-8c46-8385c68e1f5c tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:02.421657 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-d959c634-fbff-42cd-8c46-8385c68e1f5c tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306" status: 200 len: 1520 microversion: 2.1 time: 0.503531 May 19 13:33:02.435654 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 122/221] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:01 2022] GET /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306 => generated 1520 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:02.537367 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-252610da-bca6-4ad4-976d-1d556a22f721 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "POST /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10/action" status: 202 len: 0 microversion: 2.20 time: 0.698420 May 19 13:33:02.541522 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 100/222] 10.222.0.24 () {62 vars in 1318 bytes} [Thu May 19 13:33:01 2022] POST /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10/action => generated 0 bytes in 703 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 19 13:33:02.546942 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-30832b10-de61-4c77-ba24-ab39ed7aa376 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:02.547538 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-30832b10-de61-4c77-ba24-ab39ed7aa376 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:02.564606 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-30832b10-de61-4c77-ba24-ab39ed7aa376 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:02.565045 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-30832b10-de61-4c77-ba24-ab39ed7aa376 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:02.566391 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-30832b10-de61-4c77-ba24-ab39ed7aa376 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:02.567288 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-30832b10-de61-4c77-ba24-ab39ed7aa376 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:02.764858 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-1f81c9e3-1747-4c0d-9da1-5a551cd32fd9 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:02.765502 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-1f81c9e3-1747-4c0d-9da1-5a551cd32fd9 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] [instance: 383e7076-b435-4ecd-81d1-d7154800cab0] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:02.774087 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-1f81c9e3-1747-4c0d-9da1-5a551cd32fd9 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:02.774546 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-1f81c9e3-1747-4c0d-9da1-5a551cd32fd9 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:02.775420 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-1f81c9e3-1747-4c0d-9da1-5a551cd32fd9 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:02.775848 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-1f81c9e3-1747-4c0d-9da1-5a551cd32fd9 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:02.910467 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-30832b10-de61-4c77-ba24-ab39ed7aa376 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:02.920492 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-30832b10-de61-4c77-ba24-ab39ed7aa376 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:02.924580 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-30832b10-de61-4c77-ba24-ab39ed7aa376 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:02.930274 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-30832b10-de61-4c77-ba24-ab39ed7aa376 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1724 microversion: 2.20 time: 0.384480 May 19 13:33:02.931375 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 123/223] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:33:02 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1724 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:33:02.976326 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-1f81c9e3-1747-4c0d-9da1-5a551cd32fd9 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a8a480afb3438cb269ebd710c78018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26987661f54291b3cf7086b0a1c98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:02.985986 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-1f81c9e3-1747-4c0d-9da1-5a551cd32fd9 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] 10.222.0.24 "GET /compute/v2.1/servers/383e7076-b435-4ecd-81d1-d7154800cab0" status: 200 len: 1497 microversion: 2.1 time: 0.226388 May 19 13:33:03.017540 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 101/224] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:02 2022] GET /compute/v2.1/servers/383e7076-b435-4ecd-81d1-d7154800cab0 => generated 1497 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:03.442185 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-d11fda31-5d8f-4436-a1e0-7b9ea5148cdf tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:03.442789 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-d11fda31-5d8f-4436-a1e0-7b9ea5148cdf tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: c4c1abc9-8651-4788-9650-27704ae7e306] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:03.457138 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-d11fda31-5d8f-4436-a1e0-7b9ea5148cdf tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:03.457657 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-d11fda31-5d8f-4436-a1e0-7b9ea5148cdf tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:03.458893 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-d11fda31-5d8f-4436-a1e0-7b9ea5148cdf tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:03.459420 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-d11fda31-5d8f-4436-a1e0-7b9ea5148cdf tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:03.674959 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-d11fda31-5d8f-4436-a1e0-7b9ea5148cdf tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:03.685943 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-d11fda31-5d8f-4436-a1e0-7b9ea5148cdf tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306" status: 200 len: 1520 microversion: 2.1 time: 0.248130 May 19 13:33:03.687349 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 124/225] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:03 2022] GET /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306 => generated 1520 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:03.955141 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-754ce20e-c8fc-4ef3-b6cf-e1d165950ef0 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:03.955752 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-754ce20e-c8fc-4ef3-b6cf-e1d165950ef0 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:03.969110 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-754ce20e-c8fc-4ef3-b6cf-e1d165950ef0 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:03.970665 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-754ce20e-c8fc-4ef3-b6cf-e1d165950ef0 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:03.971526 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-754ce20e-c8fc-4ef3-b6cf-e1d165950ef0 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:03.972216 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-754ce20e-c8fc-4ef3-b6cf-e1d165950ef0 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:04.143740 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-754ce20e-c8fc-4ef3-b6cf-e1d165950ef0 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:04.152916 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-754ce20e-c8fc-4ef3-b6cf-e1d165950ef0 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:04.157327 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-754ce20e-c8fc-4ef3-b6cf-e1d165950ef0 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:04.158827 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-754ce20e-c8fc-4ef3-b6cf-e1d165950ef0 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1724 microversion: 2.20 time: 0.212803 May 19 13:33:04.170712 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 102/226] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:33:03 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1724 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:33:04.704784 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-e7579e28-9f0b-4cc6-8b00-a1407ec246c5 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:04.706055 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-e7579e28-9f0b-4cc6-8b00-a1407ec246c5 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: c4c1abc9-8651-4788-9650-27704ae7e306] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:04.712522 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-e7579e28-9f0b-4cc6-8b00-a1407ec246c5 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:04.713229 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-e7579e28-9f0b-4cc6-8b00-a1407ec246c5 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:04.714381 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-e7579e28-9f0b-4cc6-8b00-a1407ec246c5 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:04.715029 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-e7579e28-9f0b-4cc6-8b00-a1407ec246c5 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:04.878807 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-e7579e28-9f0b-4cc6-8b00-a1407ec246c5 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:04.888239 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-e7579e28-9f0b-4cc6-8b00-a1407ec246c5 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306" status: 200 len: 1520 microversion: 2.1 time: 0.188416 May 19 13:33:04.889692 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 125/227] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:04 2022] GET /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306 => generated 1520 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:05.177586 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-2041bc14-e16a-4ad3-9039-69070774c00f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:05.178775 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-2041bc14-e16a-4ad3-9039-69070774c00f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:05.185166 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-2041bc14-e16a-4ad3-9039-69070774c00f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:05.185902 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-2041bc14-e16a-4ad3-9039-69070774c00f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:05.186727 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-2041bc14-e16a-4ad3-9039-69070774c00f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:05.187220 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-2041bc14-e16a-4ad3-9039-69070774c00f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:05.354829 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-2041bc14-e16a-4ad3-9039-69070774c00f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:05.363549 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-2041bc14-e16a-4ad3-9039-69070774c00f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:05.365046 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-2041bc14-e16a-4ad3-9039-69070774c00f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:05.366301 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-2041bc14-e16a-4ad3-9039-69070774c00f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1724 microversion: 2.20 time: 0.192603 May 19 13:33:05.378416 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 103/228] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:33:05 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1724 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:33:05.910274 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-1d53c761-a4ad-4504-b407-589330675068 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:05.911544 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-1d53c761-a4ad-4504-b407-589330675068 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: c4c1abc9-8651-4788-9650-27704ae7e306] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:05.923481 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-1d53c761-a4ad-4504-b407-589330675068 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:05.924326 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-1d53c761-a4ad-4504-b407-589330675068 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:05.925126 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-1d53c761-a4ad-4504-b407-589330675068 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:05.925959 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-1d53c761-a4ad-4504-b407-589330675068 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:06.083691 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-1d53c761-a4ad-4504-b407-589330675068 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:06.094621 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-1d53c761-a4ad-4504-b407-589330675068 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306" status: 200 len: 1520 microversion: 2.1 time: 0.191218 May 19 13:33:06.095844 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 126/229] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:05 2022] GET /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306 => generated 1520 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:06.302200 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-aa93ee1f-163b-4fac-bcfd-2c45f3e2e22a tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:06.303309 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-aa93ee1f-163b-4fac-bcfd-2c45f3e2e22a tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] [instance: 383e7076-b435-4ecd-81d1-d7154800cab0] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:06.310808 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-aa93ee1f-163b-4fac-bcfd-2c45f3e2e22a tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:06.311247 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-aa93ee1f-163b-4fac-bcfd-2c45f3e2e22a tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:06.312018 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-aa93ee1f-163b-4fac-bcfd-2c45f3e2e22a tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:06.312497 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-aa93ee1f-163b-4fac-bcfd-2c45f3e2e22a tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:06.340106 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-aa93ee1f-163b-4fac-bcfd-2c45f3e2e22a tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] [instance: 383e7076-b435-4ecd-81d1-d7154800cab0] Going to try to terminate instance {{(pid=120472) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 13:33:06.384811 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-537b0068-87c2-49a1-8353-481757d61189 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:06.385589 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-537b0068-87c2-49a1-8353-481757d61189 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:06.397108 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-537b0068-87c2-49a1-8353-481757d61189 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:06.397931 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-537b0068-87c2-49a1-8353-481757d61189 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:06.399024 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-537b0068-87c2-49a1-8353-481757d61189 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:06.399639 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-537b0068-87c2-49a1-8353-481757d61189 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:06.445632 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-aa93ee1f-163b-4fac-bcfd-2c45f3e2e22a tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] 10.222.0.24 "DELETE /compute/v2.1/servers/383e7076-b435-4ecd-81d1-d7154800cab0" status: 204 len: 0 microversion: 2.1 time: 0.146636 May 19 13:33:06.449394 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 104/230] 10.222.0.24 () {58 vars in 1238 bytes} [Thu May 19 13:33:06 2022] DELETE /compute/v2.1/servers/383e7076-b435-4ecd-81d1-d7154800cab0 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 13:33:06.456007 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-6c8631a9-e490-425b-84ef-b77aeaf2b0bf tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:06.456702 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-6c8631a9-e490-425b-84ef-b77aeaf2b0bf tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] [instance: 383e7076-b435-4ecd-81d1-d7154800cab0] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:06.466176 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-6c8631a9-e490-425b-84ef-b77aeaf2b0bf tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:06.466986 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-6c8631a9-e490-425b-84ef-b77aeaf2b0bf tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:06.467936 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-6c8631a9-e490-425b-84ef-b77aeaf2b0bf tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:06.468517 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-6c8631a9-e490-425b-84ef-b77aeaf2b0bf tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:06.625011 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-537b0068-87c2-49a1-8353-481757d61189 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:06.637858 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-537b0068-87c2-49a1-8353-481757d61189 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:06.639925 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-537b0068-87c2-49a1-8353-481757d61189 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:06.642164 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-537b0068-87c2-49a1-8353-481757d61189 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1724 microversion: 2.20 time: 0.261244 May 19 13:33:06.655116 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 127/231] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:33:06 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1724 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:33:06.763470 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-6c8631a9-e490-425b-84ef-b77aeaf2b0bf tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a8a480afb3438cb269ebd710c78018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26987661f54291b3cf7086b0a1c98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:06.776302 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-6c8631a9-e490-425b-84ef-b77aeaf2b0bf tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] 10.222.0.24 "GET /compute/v2.1/servers/383e7076-b435-4ecd-81d1-d7154800cab0" status: 200 len: 1503 microversion: 2.1 time: 0.325039 May 19 13:33:06.776883 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 105/232] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:06 2022] GET /compute/v2.1/servers/383e7076-b435-4ecd-81d1-d7154800cab0 => generated 1503 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:07.122473 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-a00a9b89-8f86-470d-863c-ef020335f0c5 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:07.123295 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-a00a9b89-8f86-470d-863c-ef020335f0c5 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: c4c1abc9-8651-4788-9650-27704ae7e306] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:07.139427 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-a00a9b89-8f86-470d-863c-ef020335f0c5 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:07.140085 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-a00a9b89-8f86-470d-863c-ef020335f0c5 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:07.141078 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-a00a9b89-8f86-470d-863c-ef020335f0c5 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:07.141723 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-a00a9b89-8f86-470d-863c-ef020335f0c5 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:07.371076 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-a00a9b89-8f86-470d-863c-ef020335f0c5 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:07.395770 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-a00a9b89-8f86-470d-863c-ef020335f0c5 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306" status: 200 len: 1520 microversion: 2.1 time: 0.281347 May 19 13:33:07.405434 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 128/233] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:07 2022] GET /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306 => generated 1520 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:07.660136 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-b94e0a10-b2ee-4f62-a511-53a3a5ddcf63 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:07.660731 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-b94e0a10-b2ee-4f62-a511-53a3a5ddcf63 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:07.674949 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-b94e0a10-b2ee-4f62-a511-53a3a5ddcf63 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:07.678474 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-b94e0a10-b2ee-4f62-a511-53a3a5ddcf63 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:07.681492 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-b94e0a10-b2ee-4f62-a511-53a3a5ddcf63 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:07.682063 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-b94e0a10-b2ee-4f62-a511-53a3a5ddcf63 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:07.794144 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-7fc467bb-64fb-43de-baed-bb4115d2d345 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:07.795061 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-7fc467bb-64fb-43de-baed-bb4115d2d345 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] [instance: 383e7076-b435-4ecd-81d1-d7154800cab0] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:07.805538 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-7fc467bb-64fb-43de-baed-bb4115d2d345 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:07.806992 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-7fc467bb-64fb-43de-baed-bb4115d2d345 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:07.808027 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-7fc467bb-64fb-43de-baed-bb4115d2d345 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:07.809902 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-7fc467bb-64fb-43de-baed-bb4115d2d345 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:07.872798 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-b94e0a10-b2ee-4f62-a511-53a3a5ddcf63 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:07.891499 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-b94e0a10-b2ee-4f62-a511-53a3a5ddcf63 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:07.897142 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-b94e0a10-b2ee-4f62-a511-53a3a5ddcf63 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:07.899024 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-b94e0a10-b2ee-4f62-a511-53a3a5ddcf63 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1724 microversion: 2.20 time: 0.242609 May 19 13:33:07.904381 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 106/234] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:33:07 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1724 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:33:08.045163 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-7fc467bb-64fb-43de-baed-bb4115d2d345 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a8a480afb3438cb269ebd710c78018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26987661f54291b3cf7086b0a1c98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:08.055547 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-7fc467bb-64fb-43de-baed-bb4115d2d345 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] 10.222.0.24 "GET /compute/v2.1/servers/383e7076-b435-4ecd-81d1-d7154800cab0" status: 200 len: 1503 microversion: 2.1 time: 0.265491 May 19 13:33:08.064551 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 129/235] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:07 2022] GET /compute/v2.1/servers/383e7076-b435-4ecd-81d1-d7154800cab0 => generated 1503 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:33:08.425984 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-aaeeabd5-0cf5-410d-a8b3-58688c59aca6 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:08.426606 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-aaeeabd5-0cf5-410d-a8b3-58688c59aca6 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: c4c1abc9-8651-4788-9650-27704ae7e306] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:08.436028 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-aaeeabd5-0cf5-410d-a8b3-58688c59aca6 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:08.438022 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-aaeeabd5-0cf5-410d-a8b3-58688c59aca6 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:08.440872 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-aaeeabd5-0cf5-410d-a8b3-58688c59aca6 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:08.441527 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-aaeeabd5-0cf5-410d-a8b3-58688c59aca6 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:08.660197 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-aaeeabd5-0cf5-410d-a8b3-58688c59aca6 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:08.668373 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-aaeeabd5-0cf5-410d-a8b3-58688c59aca6 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306" status: 200 len: 1520 microversion: 2.1 time: 0.247800 May 19 13:33:08.678274 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 107/236] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:08 2022] GET /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306 => generated 1520 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:08.925881 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-7ebbb519-7665-40b5-bece-0eca7401193e tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:08.926497 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-7ebbb519-7665-40b5-bece-0eca7401193e tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:08.949329 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-7ebbb519-7665-40b5-bece-0eca7401193e tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:08.951570 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-7ebbb519-7665-40b5-bece-0eca7401193e tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:08.954010 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-7ebbb519-7665-40b5-bece-0eca7401193e tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:08.956844 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-7ebbb519-7665-40b5-bece-0eca7401193e tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:08.977338 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [req-4be5d03c-41fe-4952-a01d-699d18f741ca req-ba192600-9277-4ea3-a435-10be40958227 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "383e7076-b435-4ecd-81d1-d7154800cab0", "name": "network-vif-deleted", "tag": "de61cd08-bee3-42ae-b8ef-49a50a8b7e3c"}]} {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:33:09.023998 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [req-4be5d03c-41fe-4952-a01d-699d18f741ca req-ba192600-9277-4ea3-a435-10be40958227 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:09.026821 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [req-4be5d03c-41fe-4952-a01d-699d18f741ca req-ba192600-9277-4ea3-a435-10be40958227 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:09.101493 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.compute.server_external_events [req-4be5d03c-41fe-4952-a01d-699d18f741ca req-ba192600-9277-4ea3-a435-10be40958227 service nova] Creating event network-vif-deleted:de61cd08-bee3-42ae-b8ef-49a50a8b7e3c for instance 383e7076-b435-4ecd-81d1-d7154800cab0 on hv-cinder-84112 May 19 13:33:09.147069 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [req-4be5d03c-41fe-4952-a01d-699d18f741ca req-ba192600-9277-4ea3-a435-10be40958227 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149498 May 19 13:33:09.147770 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 108/237] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:33:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:33:09.163289 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-b4f53c40-044f-4a70-8473-5f6b7d620546 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:09.163982 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-b4f53c40-044f-4a70-8473-5f6b7d620546 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] [instance: 383e7076-b435-4ecd-81d1-d7154800cab0] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:09.182925 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-b4f53c40-044f-4a70-8473-5f6b7d620546 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:09.183770 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-b4f53c40-044f-4a70-8473-5f6b7d620546 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:09.184936 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-b4f53c40-044f-4a70-8473-5f6b7d620546 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:09.185749 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-b4f53c40-044f-4a70-8473-5f6b7d620546 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:09.228813 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-b4f53c40-044f-4a70-8473-5f6b7d620546 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:09.230336 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-b4f53c40-044f-4a70-8473-5f6b7d620546 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:09.231659 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.objects.instance [None req-b4f53c40-044f-4a70-8473-5f6b7d620546 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lazy-loading 'fault' on Instance uuid 383e7076-b435-4ecd-81d1-d7154800cab0 {{(pid=120472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 13:33:09.290322 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-b4f53c40-044f-4a70-8473-5f6b7d620546 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a8a480afb3438cb269ebd710c78018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26987661f54291b3cf7086b0a1c98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:09.306800 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-b4f53c40-044f-4a70-8473-5f6b7d620546 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] 10.222.0.24 "GET /compute/v2.1/servers/383e7076-b435-4ecd-81d1-d7154800cab0" status: 200 len: 1304 microversion: 2.1 time: 0.157805 May 19 13:33:09.308095 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 109/238] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:09 2022] GET /compute/v2.1/servers/383e7076-b435-4ecd-81d1-d7154800cab0 => generated 1304 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:09.384901 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-7ebbb519-7665-40b5-bece-0eca7401193e tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:09.399143 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-7ebbb519-7665-40b5-bece-0eca7401193e tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:09.401236 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-7ebbb519-7665-40b5-bece-0eca7401193e tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:09.402598 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-7ebbb519-7665-40b5-bece-0eca7401193e tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1724 microversion: 2.20 time: 0.484346 May 19 13:33:09.414472 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 130/239] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:33:08 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1724 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:33:09.697777 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-425a0d2f-5537-4edf-baf4-7ec34eb6ec38 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:09.698244 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-425a0d2f-5537-4edf-baf4-7ec34eb6ec38 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: c4c1abc9-8651-4788-9650-27704ae7e306] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:09.712702 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-425a0d2f-5537-4edf-baf4-7ec34eb6ec38 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:09.715094 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-425a0d2f-5537-4edf-baf4-7ec34eb6ec38 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:09.717057 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-425a0d2f-5537-4edf-baf4-7ec34eb6ec38 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:09.720620 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-425a0d2f-5537-4edf-baf4-7ec34eb6ec38 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:09.960602 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-425a0d2f-5537-4edf-baf4-7ec34eb6ec38 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:09.972290 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-425a0d2f-5537-4edf-baf4-7ec34eb6ec38 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306" status: 200 len: 1520 microversion: 2.1 time: 0.290877 May 19 13:33:09.974416 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 110/240] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:09 2022] GET /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306 => generated 1520 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:10.324926 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-36416f58-ab0f-46f2-b916-9bdc610bede3 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:10.325736 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-36416f58-ab0f-46f2-b916-9bdc610bede3 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] [instance: 383e7076-b435-4ecd-81d1-d7154800cab0] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:10.335358 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-36416f58-ab0f-46f2-b916-9bdc610bede3 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:10.335814 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-36416f58-ab0f-46f2-b916-9bdc610bede3 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:10.338875 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-36416f58-ab0f-46f2-b916-9bdc610bede3 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:10.339320 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-36416f58-ab0f-46f2-b916-9bdc610bede3 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:10.361941 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.wsgi [None req-36416f58-ab0f-46f2-b916-9bdc610bede3 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] HTTP exception thrown: Instance 383e7076-b435-4ecd-81d1-d7154800cab0 could not be found. May 19 13:33:10.364074 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-36416f58-ab0f-46f2-b916-9bdc610bede3 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Request method failure captured: May 19 13:33:10.364074 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: request: GET /compute/v2.1/servers/383e7076-b435-4ecd-81d1-d7154800cab0 HTTP/1.1 May 19 13:33:10.364074 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Accept: application/json May 19 13:33:10.364074 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Accept-Encoding: identity May 19 13:33:10.364074 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Connection: close May 19 13:33:10.364074 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Content-Length: 0 May 19 13:33:10.364074 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Content-Type: application/json May 19 13:33:10.364074 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Host: 10.222.0.24 May 19 13:33:10.364074 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Openstack-System-Scope: None May 19 13:33:10.364074 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: User-Agent: python-urllib3/1.26.9 May 19 13:33:10.364074 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Auth-Token: gAAAAABihkb29HEtm4Ykrx4gIr1Gitue5MpyPR-7XiOh2GS2HUQqkNpho0MwZA134nMMtsL8ZG3yxk8SB5UYMbgQAN9vW9O9Uqh_pc9HTo-ebUxjvJP9tpfXQvPZUBkTkOdFp84o06RHkv085MNr19LegdibNtUGUhND3PW1VPiae4Ew-rihRtA May 19 13:33:10.364074 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Domain-Id: None May 19 13:33:10.364074 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Domain-Name: None May 19 13:33:10.364074 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Identity-Status: Confirmed May 19 13:33:10.364074 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Is-Admin-Project: True May 19 13:33:10.364074 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Domain-Id: default May 19 13:33:10.364074 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Domain-Name: Default May 19 13:33:10.364074 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Id: 5a26987661f54291b3cf7086b0a1c98c May 19 13:33:10.364074 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Name: tempest-VolumesActionsTest-939624476 May 19 13:33:10.364074 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Role: reader,member May 19 13:33:10.364074 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Roles: reader,member May 19 13:33:10.365339 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/5a26987661f54291b3cf7086b0a1c98c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/5a26987661f54291b3cf7086b0a1c98c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_5a26987661f54291b3cf7086b0a1c98c", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/5a26987661f54291b3cf7086b0a1c98c"}]}] May 19 13:33:10.365339 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Tenant: tempest-VolumesActionsTest-939624476 May 19 13:33:10.365339 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Tenant-Id: 5a26987661f54291b3cf7086b0a1c98c May 19 13:33:10.365339 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Tenant-Name: tempest-VolumesActionsTest-939624476 May 19 13:33:10.365339 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User: tempest-VolumesActionsTest-939624476-project May 19 13:33:10.365339 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Domain-Id: default May 19 13:33:10.365339 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Domain-Name: Default May 19 13:33:10.365339 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Id: d9a8a480afb3438cb269ebd710c78018 May 19 13:33:10.365339 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Name: tempest-VolumesActionsTest-939624476-project May 19 13:33:10.365339 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: method: > May 19 13:33:10.365339 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: exception: Instance 383e7076-b435-4ecd-81d1-d7154800cab0 could not be found. May 19 13:33:10.365339 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: action_args: {'id': '383e7076-b435-4ecd-81d1-d7154800cab0'} May 19 13:33:10.366105 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:33:10.366105 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:33:10.366105 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 13:33:10.366105 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 13:33:10.366105 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 13:33:10.366105 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 13:33:10.366105 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 13:33:10.366105 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 13:33:10.366105 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 13:33:10.366105 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 13:33:10.366105 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 383e7076-b435-4ecd-81d1-d7154800cab0 could not be found. May 19 13:33:10.366105 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:33:10.366105 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:33:10.366105 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:33:10.366105 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:33:10.366105 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:33:10.366105 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:33:10.366105 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:33:10.366105 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:33:10.366105 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:33:10.367237 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:33:10.367237 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 13:33:10.367237 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 13:33:10.367237 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 13:33:10.367237 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 13:33:10.367237 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 13:33:10.367237 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 13:33:10.367237 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 383e7076-b435-4ecd-81d1-d7154800cab0 could not be found. May 19 13:33:10.367237 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:33:10.367237 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:33:10.367237 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:33:10.367237 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:33:10.367237 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:33:10.367237 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:33:10.367237 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:33:10.367237 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:33:10.367237 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 383e7076-b435-4ecd-81d1-d7154800cab0 could not be found. May 19 13:33:10.367237 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:33:10.368245 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-36416f58-ab0f-46f2-b916-9bdc610bede3 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Returning 404 to user: Instance 383e7076-b435-4ecd-81d1-d7154800cab0 could not be found. {{(pid=120471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:33:10.368245 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-36416f58-ab0f-46f2-b916-9bdc610bede3 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] 10.222.0.24 "GET /compute/v2.1/servers/383e7076-b435-4ecd-81d1-d7154800cab0" status: 404 len: 111 microversion: 2.1 time: 0.045144 May 19 13:33:10.378204 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 131/241] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:10 2022] GET /compute/v2.1/servers/383e7076-b435-4ecd-81d1-d7154800cab0 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 13:33:10.427121 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-13491e37-a77b-4ad7-b1a8-15b9e8176365 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:10.427913 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-13491e37-a77b-4ad7-b1a8-15b9e8176365 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:10.437399 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-13491e37-a77b-4ad7-b1a8-15b9e8176365 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:10.437865 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-13491e37-a77b-4ad7-b1a8-15b9e8176365 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:10.438624 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-13491e37-a77b-4ad7-b1a8-15b9e8176365 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:10.439044 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-13491e37-a77b-4ad7-b1a8-15b9e8176365 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:10.468470 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:33:10.537829 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-0a50bea2-19dd-45f6-94a3-9a22743c0300 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2088865884", "imageRef": "9beb860d-9c3f-4244-80aa-71a9c337a429", "flavorRef": "452", "networks": [{"uuid": "3d1b865b-9b95-4b9e-a3a5-0eb7b7719b88"}]}} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:33:10.597761 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.network.neutron [None req-0a50bea2-19dd-45f6-94a3-9a22743c0300 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] validate_networks() for [('3d1b865b-9b95-4b9e-a3a5-0eb7b7719b88', None, None, None, None, None)] {{(pid=120471) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 13:33:10.601621 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-13491e37-a77b-4ad7-b1a8-15b9e8176365 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:10.610358 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-13491e37-a77b-4ad7-b1a8-15b9e8176365 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:10.613259 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-13491e37-a77b-4ad7-b1a8-15b9e8176365 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:10.615043 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-13491e37-a77b-4ad7-b1a8-15b9e8176365 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1724 microversion: 2.20 time: 0.196317 May 19 13:33:10.616025 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 111/242] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:33:10 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1724 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:33:10.630763 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-b2073db7-e005-4184-a32a-e5a05f846c46 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Action: 'create', calling method: .version_select at 0x7f7c2aab0ca0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-534003201", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFV+Q6Fh4vQCrr+YOlwhw1k5yDtLTj+SNmrA0w8rTtSp4vQkcqsfB5s9YIDczHoK8ak+9BjwHomkf65aRl9MFOQzr/GcGcjqmIag4eEF/SANI/3yz4kfWHrAnUe9jdPOJA=="}} {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:33:10.646369 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.quota [None req-b2073db7-e005-4184-a32a-e5a05f846c46 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Getting quotas for project 510387333865470196f9be30ef62395c. Resources: {'key_pairs'} {{(pid=120472) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 13:33:10.650315 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.quota [None req-b2073db7-e005-4184-a32a-e5a05f846c46 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Getting quotas for user b11df35c0e4541deaea0494759301a94 and project 510387333865470196f9be30ef62395c. Resources: {'key_pairs'} {{(pid=120472) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 13:33:10.676123 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-b2073db7-e005-4184-a32a-e5a05f846c46 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.057548 May 19 13:33:10.677945 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 112/243] 10.222.0.24 () {60 vars in 1158 bytes} [Thu May 19 13:33:10 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:33:10.814706 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-b15f40e6-67b3-41f4-b097-b7004ab6550c tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-412222809", "imageRef": "b5b82588-68d6-4f31-85ed-d037ed994bab", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-534003201", "networks": [{"uuid": "12b173b5-88a3-4bd8-bf94-8afe06af1cca"}]}} {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:33:10.875249 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.network.neutron [None req-b15f40e6-67b3-41f4-b097-b7004ab6550c tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] validate_networks() for [('12b173b5-88a3-4bd8-bf94-8afe06af1cca', None, None, None, None, None)] {{(pid=120472) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 13:33:11.043045 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.virt.hardware [None req-0a50bea2-19dd-45f6-94a3-9a22743c0300 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Flavor limits 0:0:0 {{(pid=120471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 13:33:11.043450 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.virt.hardware [None req-0a50bea2-19dd-45f6-94a3-9a22743c0300 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Image limits 0:0:0 {{(pid=120471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 13:33:11.044091 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.virt.hardware [None req-0a50bea2-19dd-45f6-94a3-9a22743c0300 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Flavor pref 0:0:0 {{(pid=120471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 13:33:11.044491 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.virt.hardware [None req-0a50bea2-19dd-45f6-94a3-9a22743c0300 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Image pref 0:0:0 {{(pid=120471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 13:33:11.045113 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.virt.hardware [None req-0a50bea2-19dd-45f6-94a3-9a22743c0300 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 13:33:11.057952 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-0a50bea2-19dd-45f6-94a3-9a22743c0300 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:11.058384 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-0a50bea2-19dd-45f6-94a3-9a22743c0300 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:11.059417 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-0a50bea2-19dd-45f6-94a3-9a22743c0300 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:11.060057 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-0a50bea2-19dd-45f6-94a3-9a22743c0300 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:11.083344 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.quota [None req-0a50bea2-19dd-45f6-94a3-9a22743c0300 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Getting quotas for project 5a26987661f54291b3cf7086b0a1c98c. Resources: {'instances', 'cores', 'ram'} {{(pid=120471) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 13:33:11.087942 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.quota [None req-0a50bea2-19dd-45f6-94a3-9a22743c0300 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Getting quotas for user d9a8a480afb3438cb269ebd710c78018 and project 5a26987661f54291b3cf7086b0a1c98c. Resources: {'instances', 'cores', 'ram'} {{(pid=120471) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 13:33:11.109629 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-0a50bea2-19dd-45f6-94a3-9a22743c0300 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Going to run 1 instances... {{(pid=120471) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 13:33:11.113633 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-0a50bea2-19dd-45f6-94a3-9a22743c0300 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] [instance: 07e97bb4-e6af-4707-a137-dd83d2887895] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9beb860d-9c3f-4244-80aa-71a9c337a429',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120471) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 13:33:11.177102 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-0a50bea2-19dd-45f6-94a3-9a22743c0300 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.644421 May 19 13:33:11.178235 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 132/244] 10.222.0.24 () {60 vars in 1146 bytes} [Thu May 19 13:33:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 646 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 13:33:11.188224 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-b6b4b818-8b26-4d13-aa3a-b244a8f3ce9a tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:11.188830 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-b6b4b818-8b26-4d13-aa3a-b244a8f3ce9a tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: c4c1abc9-8651-4788-9650-27704ae7e306] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:11.200373 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-b6b4b818-8b26-4d13-aa3a-b244a8f3ce9a tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:11.201269 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-b6b4b818-8b26-4d13-aa3a-b244a8f3ce9a tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:11.205249 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-b6b4b818-8b26-4d13-aa3a-b244a8f3ce9a tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:11.206023 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-b6b4b818-8b26-4d13-aa3a-b244a8f3ce9a tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:11.504916 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-b6b4b818-8b26-4d13-aa3a-b244a8f3ce9a tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:11.517484 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-b6b4b818-8b26-4d13-aa3a-b244a8f3ce9a tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306" status: 200 len: 1520 microversion: 2.1 time: 0.337885 May 19 13:33:11.518314 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 133/245] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:11 2022] GET /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306 => generated 1520 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:11.524522 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-72d05c34-639f-4dae-bfac-06d434f34a2e tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:11.525315 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-72d05c34-639f-4dae-bfac-06d434f34a2e tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] [instance: 07e97bb4-e6af-4707-a137-dd83d2887895] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:11.602659 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.virt.hardware [None req-b15f40e6-67b3-41f4-b097-b7004ab6550c tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Flavor limits 0:0:0 {{(pid=120472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 13:33:11.603144 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.virt.hardware [None req-b15f40e6-67b3-41f4-b097-b7004ab6550c tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Image limits 0:0:0 {{(pid=120472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 13:33:11.603860 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.virt.hardware [None req-b15f40e6-67b3-41f4-b097-b7004ab6550c tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Flavor pref 0:0:0 {{(pid=120472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 13:33:11.604332 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.virt.hardware [None req-b15f40e6-67b3-41f4-b097-b7004ab6550c tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Image pref 0:0:0 {{(pid=120472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 13:33:11.604803 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.virt.hardware [None req-b15f40e6-67b3-41f4-b097-b7004ab6550c tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 13:33:11.618367 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-b15f40e6-67b3-41f4-b097-b7004ab6550c tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:11.618919 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-b15f40e6-67b3-41f4-b097-b7004ab6550c tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:11.619955 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-b15f40e6-67b3-41f4-b097-b7004ab6550c tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:11.620575 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-b15f40e6-67b3-41f4-b097-b7004ab6550c tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:11.632627 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-72d05c34-639f-4dae-bfac-06d434f34a2e tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a8a480afb3438cb269ebd710c78018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26987661f54291b3cf7086b0a1c98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:11.648281 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.quota [None req-b15f40e6-67b3-41f4-b097-b7004ab6550c tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Getting quotas for project 510387333865470196f9be30ef62395c. Resources: {'instances', 'cores', 'ram'} {{(pid=120472) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 13:33:11.648459 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-72d05c34-639f-4dae-bfac-06d434f34a2e tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] 10.222.0.24 "GET /compute/v2.1/servers/07e97bb4-e6af-4707-a137-dd83d2887895" status: 200 len: 1214 microversion: 2.1 time: 0.128425 May 19 13:33:11.649161 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 134/246] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:11 2022] GET /compute/v2.1/servers/07e97bb4-e6af-4707-a137-dd83d2887895 => generated 1214 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:11.654658 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-9933b87b-980b-4fac-8c43-9b1656590592 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:11.654887 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-9933b87b-980b-4fac-8c43-9b1656590592 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:11.663999 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-9933b87b-980b-4fac-8c43-9b1656590592 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:11.665116 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-9933b87b-980b-4fac-8c43-9b1656590592 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:11.666209 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-9933b87b-980b-4fac-8c43-9b1656590592 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:11.667201 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-9933b87b-980b-4fac-8c43-9b1656590592 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:11.668021 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.quota [None req-b15f40e6-67b3-41f4-b097-b7004ab6550c tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Getting quotas for user b11df35c0e4541deaea0494759301a94 and project 510387333865470196f9be30ef62395c. Resources: {'instances', 'cores', 'ram'} {{(pid=120472) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 13:33:11.709027 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-b15f40e6-67b3-41f4-b097-b7004ab6550c tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Going to run 1 instances... {{(pid=120472) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 13:33:11.713057 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-b15f40e6-67b3-41f4-b097-b7004ab6550c tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] [instance: c97e472c-540e-4bd5-abaf-d7dadac8c6be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b5b82588-68d6-4f31-85ed-d037ed994bab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120472) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 13:33:11.803274 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-b15f40e6-67b3-41f4-b097-b7004ab6550c tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.993425 May 19 13:33:11.804401 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 113/247] 10.222.0.24 () {60 vars in 1146 bytes} [Thu May 19 13:33:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 995 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 13:33:11.819873 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-44f21aec-7eda-448d-a99e-40c5a7c08e15 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:11.822636 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-44f21aec-7eda-448d-a99e-40c5a7c08e15 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] [instance: c97e472c-540e-4bd5-abaf-d7dadac8c6be] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:11.867344 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-9933b87b-980b-4fac-8c43-9b1656590592 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:11.883909 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-9933b87b-980b-4fac-8c43-9b1656590592 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:11.888670 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-9933b87b-980b-4fac-8c43-9b1656590592 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:11.890086 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-9933b87b-980b-4fac-8c43-9b1656590592 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1724 microversion: 2.20 time: 0.239809 May 19 13:33:11.896617 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 135/248] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:33:11 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1724 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:33:11.929485 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-44f21aec-7eda-448d-a99e-40c5a7c08e15 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11df35c0e4541deaea0494759301a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '510387333865470196f9be30ef62395c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:11.950982 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-44f21aec-7eda-448d-a99e-40c5a7c08e15 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] 10.222.0.24 "GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be" status: 200 len: 1257 microversion: 2.1 time: 0.140752 May 19 13:33:11.956411 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 114/249] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:11 2022] GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be => generated 1257 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:33:12.534898 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-e606471e-e692-48ae-833f-d8a04d351c08 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:12.535452 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-e606471e-e692-48ae-833f-d8a04d351c08 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: c4c1abc9-8651-4788-9650-27704ae7e306] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:12.548573 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-e606471e-e692-48ae-833f-d8a04d351c08 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:12.549261 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-e606471e-e692-48ae-833f-d8a04d351c08 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:12.549833 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-e606471e-e692-48ae-833f-d8a04d351c08 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:12.557492 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-e606471e-e692-48ae-833f-d8a04d351c08 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:12.666724 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-bff8d814-4e24-4e53-808f-8e3a43f8848b tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:12.667898 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-bff8d814-4e24-4e53-808f-8e3a43f8848b tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] [instance: 07e97bb4-e6af-4707-a137-dd83d2887895] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:12.677727 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-bff8d814-4e24-4e53-808f-8e3a43f8848b tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:12.684097 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-bff8d814-4e24-4e53-808f-8e3a43f8848b tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:12.692737 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-bff8d814-4e24-4e53-808f-8e3a43f8848b tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:12.693459 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-bff8d814-4e24-4e53-808f-8e3a43f8848b tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:12.864216 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-e606471e-e692-48ae-833f-d8a04d351c08 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:12.872271 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-e606471e-e692-48ae-833f-d8a04d351c08 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306" status: 200 len: 1520 microversion: 2.1 time: 0.341714 May 19 13:33:12.883201 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 136/250] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:12 2022] GET /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306 => generated 1520 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:12.898539 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-bff8d814-4e24-4e53-808f-8e3a43f8848b tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a8a480afb3438cb269ebd710c78018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26987661f54291b3cf7086b0a1c98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:12.909530 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-bff8d814-4e24-4e53-808f-8e3a43f8848b tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] 10.222.0.24 "GET /compute/v2.1/servers/07e97bb4-e6af-4707-a137-dd83d2887895" status: 200 len: 1274 microversion: 2.1 time: 0.247122 May 19 13:33:12.916324 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-03a17ede-4e1f-4b67-9485-f307b640779d tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:12.917847 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-03a17ede-4e1f-4b67-9485-f307b640779d tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:12.927672 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 115/251] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:12 2022] GET /compute/v2.1/servers/07e97bb4-e6af-4707-a137-dd83d2887895 => generated 1274 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:12.930940 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-03a17ede-4e1f-4b67-9485-f307b640779d tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:12.932866 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-03a17ede-4e1f-4b67-9485-f307b640779d tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:12.933654 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-03a17ede-4e1f-4b67-9485-f307b640779d tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:12.937543 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-03a17ede-4e1f-4b67-9485-f307b640779d tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:12.980946 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-f1c40b7b-ec87-43b4-8395-4c2749ab57c0 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:12.981955 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-f1c40b7b-ec87-43b4-8395-4c2749ab57c0 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] [instance: c97e472c-540e-4bd5-abaf-d7dadac8c6be] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:12.996203 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-f1c40b7b-ec87-43b4-8395-4c2749ab57c0 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:12.997846 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-f1c40b7b-ec87-43b4-8395-4c2749ab57c0 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:13.000012 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-f1c40b7b-ec87-43b4-8395-4c2749ab57c0 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:13.001517 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-f1c40b7b-ec87-43b4-8395-4c2749ab57c0 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:13.123726 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-f1c40b7b-ec87-43b4-8395-4c2749ab57c0 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11df35c0e4541deaea0494759301a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '510387333865470196f9be30ef62395c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:13.132993 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-f1c40b7b-ec87-43b4-8395-4c2749ab57c0 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] 10.222.0.24 "GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be" status: 200 len: 1309 microversion: 2.1 time: 0.163965 May 19 13:33:13.134596 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 116/252] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:12 2022] GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be => generated 1309 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:13.183576 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-03a17ede-4e1f-4b67-9485-f307b640779d tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:13.205163 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-03a17ede-4e1f-4b67-9485-f307b640779d tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:13.209834 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-03a17ede-4e1f-4b67-9485-f307b640779d tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:13.214379 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-03a17ede-4e1f-4b67-9485-f307b640779d tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1724 microversion: 2.20 time: 0.303504 May 19 13:33:13.215255 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 137/253] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:33:12 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1724 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 13:33:13.890584 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-d1e7ba06-b07f-41e1-a550-ad80d327d130 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:13.891369 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-d1e7ba06-b07f-41e1-a550-ad80d327d130 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: c4c1abc9-8651-4788-9650-27704ae7e306] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:13.900576 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-d1e7ba06-b07f-41e1-a550-ad80d327d130 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:13.901242 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-d1e7ba06-b07f-41e1-a550-ad80d327d130 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:13.902123 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-d1e7ba06-b07f-41e1-a550-ad80d327d130 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:13.902940 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-d1e7ba06-b07f-41e1-a550-ad80d327d130 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:13.929716 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-32385c6c-5c58-4e65-b3e3-f2cb794a7a05 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:13.930999 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-32385c6c-5c58-4e65-b3e3-f2cb794a7a05 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] [instance: 07e97bb4-e6af-4707-a137-dd83d2887895] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:13.939358 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-32385c6c-5c58-4e65-b3e3-f2cb794a7a05 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:13.940988 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-32385c6c-5c58-4e65-b3e3-f2cb794a7a05 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:13.941990 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-32385c6c-5c58-4e65-b3e3-f2cb794a7a05 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:13.943099 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-32385c6c-5c58-4e65-b3e3-f2cb794a7a05 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:14.065012 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-d1e7ba06-b07f-41e1-a550-ad80d327d130 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:14.080636 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-d1e7ba06-b07f-41e1-a550-ad80d327d130 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306" status: 200 len: 1520 microversion: 2.1 time: 0.194536 May 19 13:33:14.081305 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 117/254] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:13 2022] GET /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306 => generated 1520 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:14.138202 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-32385c6c-5c58-4e65-b3e3-f2cb794a7a05 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a8a480afb3438cb269ebd710c78018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26987661f54291b3cf7086b0a1c98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:14.151170 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-c6ae8270-113a-4364-96ee-a9c21f177dba tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:14.151927 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-c6ae8270-113a-4364-96ee-a9c21f177dba tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] [instance: c97e472c-540e-4bd5-abaf-d7dadac8c6be] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:14.153773 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-32385c6c-5c58-4e65-b3e3-f2cb794a7a05 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] 10.222.0.24 "GET /compute/v2.1/servers/07e97bb4-e6af-4707-a137-dd83d2887895" status: 200 len: 1314 microversion: 2.1 time: 0.228775 May 19 13:33:14.154454 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 138/255] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:13 2022] GET /compute/v2.1/servers/07e97bb4-e6af-4707-a137-dd83d2887895 => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:14.159277 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-c6ae8270-113a-4364-96ee-a9c21f177dba tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:14.159896 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-c6ae8270-113a-4364-96ee-a9c21f177dba tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:14.160657 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-c6ae8270-113a-4364-96ee-a9c21f177dba tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:14.161085 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-c6ae8270-113a-4364-96ee-a9c21f177dba tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:14.232362 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-d003ddf0-e2e1-4547-8084-9a5e9cc8cc2d tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:14.232978 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-d003ddf0-e2e1-4547-8084-9a5e9cc8cc2d tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:14.235981 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-c6ae8270-113a-4364-96ee-a9c21f177dba tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11df35c0e4541deaea0494759301a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '510387333865470196f9be30ef62395c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:14.241800 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-d003ddf0-e2e1-4547-8084-9a5e9cc8cc2d tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:14.242304 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-d003ddf0-e2e1-4547-8084-9a5e9cc8cc2d tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:14.243154 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-d003ddf0-e2e1-4547-8084-9a5e9cc8cc2d tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:14.243661 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-d003ddf0-e2e1-4547-8084-9a5e9cc8cc2d tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:14.247816 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-c6ae8270-113a-4364-96ee-a9c21f177dba tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] 10.222.0.24 "GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be" status: 200 len: 1317 microversion: 2.1 time: 0.100793 May 19 13:33:14.249626 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 118/256] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:14 2022] GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be => generated 1317 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:14.432227 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-d003ddf0-e2e1-4547-8084-9a5e9cc8cc2d tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:14.440928 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-d003ddf0-e2e1-4547-8084-9a5e9cc8cc2d tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:14.442420 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-d003ddf0-e2e1-4547-8084-9a5e9cc8cc2d tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:14.443796 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-d003ddf0-e2e1-4547-8084-9a5e9cc8cc2d tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1724 microversion: 2.20 time: 0.215621 May 19 13:33:14.444322 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 139/257] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:33:14 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1724 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 13:33:15.097661 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-a1d1f3cc-61e5-4635-8be3-9ad6de129dca tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:15.098266 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-a1d1f3cc-61e5-4635-8be3-9ad6de129dca tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: c4c1abc9-8651-4788-9650-27704ae7e306] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:15.105138 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-a1d1f3cc-61e5-4635-8be3-9ad6de129dca tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:15.105751 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-a1d1f3cc-61e5-4635-8be3-9ad6de129dca tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:15.107269 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-a1d1f3cc-61e5-4635-8be3-9ad6de129dca tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:15.107729 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-a1d1f3cc-61e5-4635-8be3-9ad6de129dca tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:15.172691 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-675f2ef2-0ed5-4278-a25b-af7212da675d tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:15.173263 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-675f2ef2-0ed5-4278-a25b-af7212da675d tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] [instance: 07e97bb4-e6af-4707-a137-dd83d2887895] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:15.188989 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-675f2ef2-0ed5-4278-a25b-af7212da675d tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:15.189713 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-675f2ef2-0ed5-4278-a25b-af7212da675d tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:15.190697 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-675f2ef2-0ed5-4278-a25b-af7212da675d tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:15.191285 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-675f2ef2-0ed5-4278-a25b-af7212da675d tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:15.306347 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-a1d1f3cc-61e5-4635-8be3-9ad6de129dca tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:15.315520 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-a1d1f3cc-61e5-4635-8be3-9ad6de129dca tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306" status: 200 len: 1520 microversion: 2.1 time: 0.221756 May 19 13:33:15.316140 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 119/258] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:15 2022] GET /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306 => generated 1520 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:15.320737 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-072ef9c4-c0c4-43cd-8ba4-8cca322e5c9c tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:15.321331 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-072ef9c4-c0c4-43cd-8ba4-8cca322e5c9c tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] [instance: c97e472c-540e-4bd5-abaf-d7dadac8c6be] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:15.327795 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-072ef9c4-c0c4-43cd-8ba4-8cca322e5c9c tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:15.328239 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-072ef9c4-c0c4-43cd-8ba4-8cca322e5c9c tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:15.328995 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-072ef9c4-c0c4-43cd-8ba4-8cca322e5c9c tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:15.329442 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-072ef9c4-c0c4-43cd-8ba4-8cca322e5c9c tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:15.357064 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-675f2ef2-0ed5-4278-a25b-af7212da675d tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a8a480afb3438cb269ebd710c78018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26987661f54291b3cf7086b0a1c98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:15.364655 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-675f2ef2-0ed5-4278-a25b-af7212da675d tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] 10.222.0.24 "GET /compute/v2.1/servers/07e97bb4-e6af-4707-a137-dd83d2887895" status: 200 len: 1314 microversion: 2.1 time: 0.197484 May 19 13:33:15.365536 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 140/259] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:15 2022] GET /compute/v2.1/servers/07e97bb4-e6af-4707-a137-dd83d2887895 => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:15.392936 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-072ef9c4-c0c4-43cd-8ba4-8cca322e5c9c tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11df35c0e4541deaea0494759301a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '510387333865470196f9be30ef62395c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:15.400525 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-072ef9c4-c0c4-43cd-8ba4-8cca322e5c9c tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] 10.222.0.24 "GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be" status: 200 len: 1317 microversion: 2.1 time: 0.083394 May 19 13:33:15.401091 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 120/260] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:15 2022] GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be => generated 1317 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:15.462076 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-3ef9bb4b-4c98-4ff6-a067-8837c536a085 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:15.462719 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-3ef9bb4b-4c98-4ff6-a067-8837c536a085 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:15.469518 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-3ef9bb4b-4c98-4ff6-a067-8837c536a085 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:15.469950 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-3ef9bb4b-4c98-4ff6-a067-8837c536a085 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:15.470893 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-3ef9bb4b-4c98-4ff6-a067-8837c536a085 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:15.471325 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-3ef9bb4b-4c98-4ff6-a067-8837c536a085 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:15.475397 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_cell1:SELECT=100 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:33:15.610014 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-3ef9bb4b-4c98-4ff6-a067-8837c536a085 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:15.619200 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-3ef9bb4b-4c98-4ff6-a067-8837c536a085 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:15.620803 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-3ef9bb4b-4c98-4ff6-a067-8837c536a085 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:15.622307 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-3ef9bb4b-4c98-4ff6-a067-8837c536a085 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1724 microversion: 2.20 time: 0.164225 May 19 13:33:15.622854 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 141/261] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:33:15 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:33:16.332964 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-f3ec9da7-471c-4d1a-9178-e08edefd70ca tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:16.333618 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-f3ec9da7-471c-4d1a-9178-e08edefd70ca tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: c4c1abc9-8651-4788-9650-27704ae7e306] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:16.340257 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-f3ec9da7-471c-4d1a-9178-e08edefd70ca tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:16.340765 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-f3ec9da7-471c-4d1a-9178-e08edefd70ca tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:16.341589 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-f3ec9da7-471c-4d1a-9178-e08edefd70ca tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:16.342036 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-f3ec9da7-471c-4d1a-9178-e08edefd70ca tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:16.381145 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-94343aa4-9616-47a0-93a1-8cef58f2bd84 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:16.381926 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-94343aa4-9616-47a0-93a1-8cef58f2bd84 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] [instance: 07e97bb4-e6af-4707-a137-dd83d2887895] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:16.388847 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-94343aa4-9616-47a0-93a1-8cef58f2bd84 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:16.389258 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-94343aa4-9616-47a0-93a1-8cef58f2bd84 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:16.390333 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-94343aa4-9616-47a0-93a1-8cef58f2bd84 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:16.390963 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-94343aa4-9616-47a0-93a1-8cef58f2bd84 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:16.480076 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-f3ec9da7-471c-4d1a-9178-e08edefd70ca tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:16.489136 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-f3ec9da7-471c-4d1a-9178-e08edefd70ca tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306" status: 200 len: 1520 microversion: 2.1 time: 0.159872 May 19 13:33:16.498988 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 121/262] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:16 2022] GET /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:16.504496 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-d5831b9c-32c8-427b-b42b-15b549ae0a01 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:16.505092 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-d5831b9c-32c8-427b-b42b-15b549ae0a01 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] [instance: c97e472c-540e-4bd5-abaf-d7dadac8c6be] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:16.512464 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-d5831b9c-32c8-427b-b42b-15b549ae0a01 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:16.512901 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-d5831b9c-32c8-427b-b42b-15b549ae0a01 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:16.513682 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-d5831b9c-32c8-427b-b42b-15b549ae0a01 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:16.514108 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-d5831b9c-32c8-427b-b42b-15b549ae0a01 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:16.529603 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-94343aa4-9616-47a0-93a1-8cef58f2bd84 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a8a480afb3438cb269ebd710c78018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26987661f54291b3cf7086b0a1c98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:16.538746 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-94343aa4-9616-47a0-93a1-8cef58f2bd84 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] 10.222.0.24 "GET /compute/v2.1/servers/07e97bb4-e6af-4707-a137-dd83d2887895" status: 200 len: 1314 microversion: 2.1 time: 0.161426 May 19 13:33:16.539315 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 142/263] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:16 2022] GET /compute/v2.1/servers/07e97bb4-e6af-4707-a137-dd83d2887895 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:16.576387 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-d5831b9c-32c8-427b-b42b-15b549ae0a01 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11df35c0e4541deaea0494759301a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '510387333865470196f9be30ef62395c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:16.584196 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-d5831b9c-32c8-427b-b42b-15b549ae0a01 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] 10.222.0.24 "GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be" status: 200 len: 1317 microversion: 2.1 time: 0.084161 May 19 13:33:16.584757 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 122/264] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:16 2022] GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be => generated 1317 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:16.641365 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-e87abae8-6d72-4e09-97ba-ac239db80b87 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:16.642019 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-e87abae8-6d72-4e09-97ba-ac239db80b87 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:16.648554 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-e87abae8-6d72-4e09-97ba-ac239db80b87 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:16.648998 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-e87abae8-6d72-4e09-97ba-ac239db80b87 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:16.649779 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-e87abae8-6d72-4e09-97ba-ac239db80b87 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:16.650211 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-e87abae8-6d72-4e09-97ba-ac239db80b87 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:16.823483 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-e87abae8-6d72-4e09-97ba-ac239db80b87 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:16.832644 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-e87abae8-6d72-4e09-97ba-ac239db80b87 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:16.834840 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-e87abae8-6d72-4e09-97ba-ac239db80b87 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:16.836242 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-e87abae8-6d72-4e09-97ba-ac239db80b87 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1724 microversion: 2.20 time: 0.199326 May 19 13:33:16.837469 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 143/265] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:33:16 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1724 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:33:17.510521 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-c039c775-d508-41d1-be15-aa80d8ddf40d tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:17.511226 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-c039c775-d508-41d1-be15-aa80d8ddf40d tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: c4c1abc9-8651-4788-9650-27704ae7e306] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:17.514226 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:33:17.529694 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-c039c775-d508-41d1-be15-aa80d8ddf40d tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:17.530391 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-c039c775-d508-41d1-be15-aa80d8ddf40d tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:17.546566 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-c039c775-d508-41d1-be15-aa80d8ddf40d tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:17.547022 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-c039c775-d508-41d1-be15-aa80d8ddf40d tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:17.556332 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-72f752b9-7ec4-45b7-856f-c8aca7ed0493 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:17.556939 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-72f752b9-7ec4-45b7-856f-c8aca7ed0493 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] [instance: 07e97bb4-e6af-4707-a137-dd83d2887895] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:17.568127 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-72f752b9-7ec4-45b7-856f-c8aca7ed0493 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:17.570639 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-72f752b9-7ec4-45b7-856f-c8aca7ed0493 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:17.572831 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-72f752b9-7ec4-45b7-856f-c8aca7ed0493 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:17.579743 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-72f752b9-7ec4-45b7-856f-c8aca7ed0493 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:17.854950 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-72f752b9-7ec4-45b7-856f-c8aca7ed0493 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a8a480afb3438cb269ebd710c78018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26987661f54291b3cf7086b0a1c98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:17.864985 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-72f752b9-7ec4-45b7-856f-c8aca7ed0493 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] 10.222.0.24 "GET /compute/v2.1/servers/07e97bb4-e6af-4707-a137-dd83d2887895" status: 200 len: 1314 microversion: 2.1 time: 0.312722 May 19 13:33:17.867835 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 144/266] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:17 2022] GET /compute/v2.1/servers/07e97bb4-e6af-4707-a137-dd83d2887895 => generated 1314 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:33:17.883831 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-a036826d-cef6-45e6-be4a-2b6c52a51892 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:17.884796 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-a036826d-cef6-45e6-be4a-2b6c52a51892 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] [instance: c97e472c-540e-4bd5-abaf-d7dadac8c6be] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:17.897558 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-a036826d-cef6-45e6-be4a-2b6c52a51892 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:17.898714 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-a036826d-cef6-45e6-be4a-2b6c52a51892 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:17.899830 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-a036826d-cef6-45e6-be4a-2b6c52a51892 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:17.903595 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-a036826d-cef6-45e6-be4a-2b6c52a51892 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:18.035161 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-c039c775-d508-41d1-be15-aa80d8ddf40d tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:18.060190 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-c039c775-d508-41d1-be15-aa80d8ddf40d tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306" status: 200 len: 1520 microversion: 2.1 time: 0.555189 May 19 13:33:18.062250 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 123/267] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:17 2022] GET /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306 => generated 1520 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:18.082585 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-d42b232b-adf9-484e-b02d-66d9281cc33f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:18.094395 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-d42b232b-adf9-484e-b02d-66d9281cc33f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:18.115511 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-d42b232b-adf9-484e-b02d-66d9281cc33f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:18.116283 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-d42b232b-adf9-484e-b02d-66d9281cc33f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:18.117299 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-d42b232b-adf9-484e-b02d-66d9281cc33f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:18.119694 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-d42b232b-adf9-484e-b02d-66d9281cc33f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:18.238759 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-a036826d-cef6-45e6-be4a-2b6c52a51892 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11df35c0e4541deaea0494759301a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '510387333865470196f9be30ef62395c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:18.255589 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-a036826d-cef6-45e6-be4a-2b6c52a51892 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] 10.222.0.24 "GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be" status: 200 len: 1357 microversion: 2.1 time: 0.384275 May 19 13:33:18.267762 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 145/268] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:17 2022] GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be => generated 1357 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:18.517533 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [req-35087c7f-c28f-4225-8f65-e112b3b5027e req-0d146fa9-a769-4050-a1be-b40ad0116588 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07e97bb4-e6af-4707-a137-dd83d2887895", "tag": "482e497d-dc94-47c6-8992-021c75b27d64"}]} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:33:18.529428 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-35087c7f-c28f-4225-8f65-e112b3b5027e req-0d146fa9-a769-4050-a1be-b40ad0116588 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:18.546594 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-35087c7f-c28f-4225-8f65-e112b3b5027e req-0d146fa9-a769-4050-a1be-b40ad0116588 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:18.563047 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.compute.server_external_events [req-35087c7f-c28f-4225-8f65-e112b3b5027e req-0d146fa9-a769-4050-a1be-b40ad0116588 service nova] Creating event network-changed:482e497d-dc94-47c6-8992-021c75b27d64 for instance 07e97bb4-e6af-4707-a137-dd83d2887895 on hv-cinder-84112 May 19 13:33:18.569245 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [req-35087c7f-c28f-4225-8f65-e112b3b5027e req-0d146fa9-a769-4050-a1be-b40ad0116588 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055604 May 19 13:33:18.570236 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 146/269] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:33:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 13:33:18.702107 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-d42b232b-adf9-484e-b02d-66d9281cc33f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:18.723324 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-d42b232b-adf9-484e-b02d-66d9281cc33f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:18.729186 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-d42b232b-adf9-484e-b02d-66d9281cc33f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:18.730659 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-d42b232b-adf9-484e-b02d-66d9281cc33f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1724 microversion: 2.20 time: 0.666073 May 19 13:33:18.732084 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 124/270] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:33:18 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1724 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:33:18.885373 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-4cf810df-bebd-4577-a735-c74ba790c59b tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:18.886390 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-4cf810df-bebd-4577-a735-c74ba790c59b tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] [instance: 07e97bb4-e6af-4707-a137-dd83d2887895] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:18.893658 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-4cf810df-bebd-4577-a735-c74ba790c59b tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:18.894350 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-4cf810df-bebd-4577-a735-c74ba790c59b tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:18.895276 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-4cf810df-bebd-4577-a735-c74ba790c59b tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:18.896120 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-4cf810df-bebd-4577-a735-c74ba790c59b tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:19.082217 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-62009c0d-2ec3-4439-a148-d5fda41b51d9 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:19.083415 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-62009c0d-2ec3-4439-a148-d5fda41b51d9 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: c4c1abc9-8651-4788-9650-27704ae7e306] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:19.099265 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-62009c0d-2ec3-4439-a148-d5fda41b51d9 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:19.105735 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-4cf810df-bebd-4577-a735-c74ba790c59b tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a8a480afb3438cb269ebd710c78018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26987661f54291b3cf7086b0a1c98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:19.108073 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-62009c0d-2ec3-4439-a148-d5fda41b51d9 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:19.109329 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-62009c0d-2ec3-4439-a148-d5fda41b51d9 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:19.111619 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-62009c0d-2ec3-4439-a148-d5fda41b51d9 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:19.118859 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-4cf810df-bebd-4577-a735-c74ba790c59b tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] 10.222.0.24 "GET /compute/v2.1/servers/07e97bb4-e6af-4707-a137-dd83d2887895" status: 200 len: 1314 microversion: 2.1 time: 0.237334 May 19 13:33:19.125465 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 147/271] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:18 2022] GET /compute/v2.1/servers/07e97bb4-e6af-4707-a137-dd83d2887895 => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:19.274064 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-ffc78f0c-faa4-41f3-8fdd-adc921a32038 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:19.274928 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-ffc78f0c-faa4-41f3-8fdd-adc921a32038 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] [instance: c97e472c-540e-4bd5-abaf-d7dadac8c6be] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:19.291439 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-ffc78f0c-faa4-41f3-8fdd-adc921a32038 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:19.297124 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-ffc78f0c-faa4-41f3-8fdd-adc921a32038 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:19.301627 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-ffc78f0c-faa4-41f3-8fdd-adc921a32038 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:19.305232 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-ffc78f0c-faa4-41f3-8fdd-adc921a32038 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:19.458019 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-62009c0d-2ec3-4439-a148-d5fda41b51d9 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:19.474417 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-62009c0d-2ec3-4439-a148-d5fda41b51d9 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306" status: 200 len: 1520 microversion: 2.1 time: 0.397451 May 19 13:33:19.475000 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 125/272] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:19 2022] GET /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306 => generated 1520 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:19.650019 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-ffc78f0c-faa4-41f3-8fdd-adc921a32038 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11df35c0e4541deaea0494759301a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '510387333865470196f9be30ef62395c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:19.660414 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-ffc78f0c-faa4-41f3-8fdd-adc921a32038 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] 10.222.0.24 "GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be" status: 200 len: 1357 microversion: 2.1 time: 0.390343 May 19 13:33:19.661579 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 148/273] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:19 2022] GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be => generated 1357 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:19.752746 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-187df081-59c7-4d12-b973-e5f5e26b24cc tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:19.753364 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-187df081-59c7-4d12-b973-e5f5e26b24cc tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:19.762067 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-187df081-59c7-4d12-b973-e5f5e26b24cc tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:19.765816 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-187df081-59c7-4d12-b973-e5f5e26b24cc tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:19.772084 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-187df081-59c7-4d12-b973-e5f5e26b24cc tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:19.772563 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-187df081-59c7-4d12-b973-e5f5e26b24cc tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:19.977866 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-187df081-59c7-4d12-b973-e5f5e26b24cc tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:19.986693 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-187df081-59c7-4d12-b973-e5f5e26b24cc tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:19.988639 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-187df081-59c7-4d12-b973-e5f5e26b24cc tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:19.990126 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-187df081-59c7-4d12-b973-e5f5e26b24cc tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1724 microversion: 2.20 time: 0.244385 May 19 13:33:19.991038 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 126/274] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:33:19 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1724 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:33:20.140932 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-5d296b46-098c-4421-bbb4-ae9ad86e0dc0 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:20.142228 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-5d296b46-098c-4421-bbb4-ae9ad86e0dc0 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] [instance: 07e97bb4-e6af-4707-a137-dd83d2887895] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:20.149061 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:33:20.150890 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-5d296b46-098c-4421-bbb4-ae9ad86e0dc0 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:20.151539 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-5d296b46-098c-4421-bbb4-ae9ad86e0dc0 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:20.152656 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-5d296b46-098c-4421-bbb4-ae9ad86e0dc0 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:20.154649 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-5d296b46-098c-4421-bbb4-ae9ad86e0dc0 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:20.349120 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-5d296b46-098c-4421-bbb4-ae9ad86e0dc0 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a8a480afb3438cb269ebd710c78018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26987661f54291b3cf7086b0a1c98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:20.362295 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-5d296b46-098c-4421-bbb4-ae9ad86e0dc0 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] 10.222.0.24 "GET /compute/v2.1/servers/07e97bb4-e6af-4707-a137-dd83d2887895" status: 200 len: 1314 microversion: 2.1 time: 0.225955 May 19 13:33:20.372395 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 149/275] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:20 2022] GET /compute/v2.1/servers/07e97bb4-e6af-4707-a137-dd83d2887895 => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:33:20.491565 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-41b15b39-e98f-4cd9-a823-c19e9804ce34 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:20.492165 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-41b15b39-e98f-4cd9-a823-c19e9804ce34 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: c4c1abc9-8651-4788-9650-27704ae7e306] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:20.499657 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-41b15b39-e98f-4cd9-a823-c19e9804ce34 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:20.500110 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-41b15b39-e98f-4cd9-a823-c19e9804ce34 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:20.503857 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-41b15b39-e98f-4cd9-a823-c19e9804ce34 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:20.504484 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-41b15b39-e98f-4cd9-a823-c19e9804ce34 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:20.681445 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-a18638d5-6871-487b-b72e-d0b781367649 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:20.682744 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-a18638d5-6871-487b-b72e-d0b781367649 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] [instance: c97e472c-540e-4bd5-abaf-d7dadac8c6be] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:20.695477 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-a18638d5-6871-487b-b72e-d0b781367649 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:20.697829 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-a18638d5-6871-487b-b72e-d0b781367649 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:20.698747 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-a18638d5-6871-487b-b72e-d0b781367649 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:20.700190 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-a18638d5-6871-487b-b72e-d0b781367649 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:20.706561 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-41b15b39-e98f-4cd9-a823-c19e9804ce34 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:20.716809 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-41b15b39-e98f-4cd9-a823-c19e9804ce34 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306" status: 200 len: 1520 microversion: 2.1 time: 0.228898 May 19 13:33:20.741927 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 127/276] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:20 2022] GET /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306 => generated 1520 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:20.926064 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-a18638d5-6871-487b-b72e-d0b781367649 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11df35c0e4541deaea0494759301a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '510387333865470196f9be30ef62395c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:20.939518 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-a18638d5-6871-487b-b72e-d0b781367649 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] 10.222.0.24 "GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be" status: 200 len: 1357 microversion: 2.1 time: 0.264762 May 19 13:33:20.952360 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 150/277] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:20 2022] GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be => generated 1357 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:21.010175 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-372241ea-de73-4e73-9377-6318f92acddc tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:21.011492 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-372241ea-de73-4e73-9377-6318f92acddc tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:21.024433 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-372241ea-de73-4e73-9377-6318f92acddc tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:21.024888 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-372241ea-de73-4e73-9377-6318f92acddc tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:21.025722 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-372241ea-de73-4e73-9377-6318f92acddc tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:21.026567 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-372241ea-de73-4e73-9377-6318f92acddc tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:21.246391 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-372241ea-de73-4e73-9377-6318f92acddc tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:21.251490 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-372241ea-de73-4e73-9377-6318f92acddc tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:21.253016 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-372241ea-de73-4e73-9377-6318f92acddc tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:21.260996 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-372241ea-de73-4e73-9377-6318f92acddc tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1724 microversion: 2.20 time: 0.254776 May 19 13:33:21.269221 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 128/278] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:33:21 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1724 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:33:21.380105 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-84f18104-a9ea-4562-b0fa-9a4b846b4a12 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:21.380697 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-84f18104-a9ea-4562-b0fa-9a4b846b4a12 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] [instance: 07e97bb4-e6af-4707-a137-dd83d2887895] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:21.383735 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_cell0:SELECT=2 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:33:21.400539 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-84f18104-a9ea-4562-b0fa-9a4b846b4a12 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:21.401000 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-84f18104-a9ea-4562-b0fa-9a4b846b4a12 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:21.401855 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-84f18104-a9ea-4562-b0fa-9a4b846b4a12 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:21.402289 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-84f18104-a9ea-4562-b0fa-9a4b846b4a12 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:21.647768 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_cell0:SELECT=8 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:33:21.654063 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-84f18104-a9ea-4562-b0fa-9a4b846b4a12 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a8a480afb3438cb269ebd710c78018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26987661f54291b3cf7086b0a1c98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:21.675929 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-84f18104-a9ea-4562-b0fa-9a4b846b4a12 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] 10.222.0.24 "GET /compute/v2.1/servers/07e97bb4-e6af-4707-a137-dd83d2887895" status: 200 len: 1314 microversion: 2.1 time: 0.300174 May 19 13:33:21.686354 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 151/279] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:21 2022] GET /compute/v2.1/servers/07e97bb4-e6af-4707-a137-dd83d2887895 => generated 1314 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:21.739681 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-e4a6f891-50e0-43c4-8d83-57cd46cfb2ad tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:21.740629 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-e4a6f891-50e0-43c4-8d83-57cd46cfb2ad tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: c4c1abc9-8651-4788-9650-27704ae7e306] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:21.746299 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_cell0:SELECT=2 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:33:21.748919 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-e4a6f891-50e0-43c4-8d83-57cd46cfb2ad tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:21.749466 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-e4a6f891-50e0-43c4-8d83-57cd46cfb2ad tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:21.750574 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-e4a6f891-50e0-43c4-8d83-57cd46cfb2ad tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:21.751194 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-e4a6f891-50e0-43c4-8d83-57cd46cfb2ad tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:21.951209 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_cell0:SELECT=12 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:33:21.966836 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-8dd91a5e-7237-4712-979f-b440d572e471 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:21.967459 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-8dd91a5e-7237-4712-979f-b440d572e471 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] [instance: c97e472c-540e-4bd5-abaf-d7dadac8c6be] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:21.977017 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-8dd91a5e-7237-4712-979f-b440d572e471 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:21.977383 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-8dd91a5e-7237-4712-979f-b440d572e471 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:21.978175 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-8dd91a5e-7237-4712-979f-b440d572e471 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:21.986154 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-8dd91a5e-7237-4712-979f-b440d572e471 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:22.058874 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-e4a6f891-50e0-43c4-8d83-57cd46cfb2ad tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:22.080299 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-e4a6f891-50e0-43c4-8d83-57cd46cfb2ad tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306" status: 200 len: 1520 microversion: 2.1 time: 0.347274 May 19 13:33:22.084908 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 129/280] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:21 2022] GET /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306 => generated 1520 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:22.213834 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-8dd91a5e-7237-4712-979f-b440d572e471 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11df35c0e4541deaea0494759301a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '510387333865470196f9be30ef62395c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:22.236642 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-8dd91a5e-7237-4712-979f-b440d572e471 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] 10.222.0.24 "GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be" status: 200 len: 1357 microversion: 2.1 time: 0.281555 May 19 13:33:22.245263 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 152/281] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:21 2022] GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be => generated 1357 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:22.288358 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-c95cd21c-7c4c-46fc-840d-fa0919b4efea tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:22.289337 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-c95cd21c-7c4c-46fc-840d-fa0919b4efea tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:22.311381 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-c95cd21c-7c4c-46fc-840d-fa0919b4efea tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:22.312514 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-c95cd21c-7c4c-46fc-840d-fa0919b4efea tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:22.313613 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-c95cd21c-7c4c-46fc-840d-fa0919b4efea tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:22.314251 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-c95cd21c-7c4c-46fc-840d-fa0919b4efea tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:22.597285 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-c95cd21c-7c4c-46fc-840d-fa0919b4efea tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:22.599558 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_cell1:SELECT=100 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:33:22.613776 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-c95cd21c-7c4c-46fc-840d-fa0919b4efea tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:22.617098 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-c95cd21c-7c4c-46fc-840d-fa0919b4efea tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:22.621137 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-c95cd21c-7c4c-46fc-840d-fa0919b4efea tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1724 microversion: 2.20 time: 0.338161 May 19 13:33:22.622735 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 130/282] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:33:22 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1724 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:33:22.697730 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-b49a7d0a-b15b-4bb2-861d-daa68c09bf0d tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:22.698431 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-b49a7d0a-b15b-4bb2-861d-daa68c09bf0d tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] [instance: 07e97bb4-e6af-4707-a137-dd83d2887895] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:22.710494 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-b49a7d0a-b15b-4bb2-861d-daa68c09bf0d tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:22.711518 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-b49a7d0a-b15b-4bb2-861d-daa68c09bf0d tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:22.713234 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-b49a7d0a-b15b-4bb2-861d-daa68c09bf0d tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:22.714208 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-b49a7d0a-b15b-4bb2-861d-daa68c09bf0d tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:22.913004 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-b49a7d0a-b15b-4bb2-861d-daa68c09bf0d tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a8a480afb3438cb269ebd710c78018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26987661f54291b3cf7086b0a1c98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:22.929453 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-b49a7d0a-b15b-4bb2-861d-daa68c09bf0d tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] 10.222.0.24 "GET /compute/v2.1/servers/07e97bb4-e6af-4707-a137-dd83d2887895" status: 200 len: 1314 microversion: 2.1 time: 0.239697 May 19 13:33:22.930651 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 153/283] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:22 2022] GET /compute/v2.1/servers/07e97bb4-e6af-4707-a137-dd83d2887895 => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:33:23.104683 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-119f4654-a9ca-47bd-a19c-444476fe12be tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:23.106759 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-119f4654-a9ca-47bd-a19c-444476fe12be tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: c4c1abc9-8651-4788-9650-27704ae7e306] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:23.126620 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-119f4654-a9ca-47bd-a19c-444476fe12be tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:23.136821 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-119f4654-a9ca-47bd-a19c-444476fe12be tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:23.141677 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-119f4654-a9ca-47bd-a19c-444476fe12be tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:23.142380 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-119f4654-a9ca-47bd-a19c-444476fe12be tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:23.266626 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-09e435f9-cf30-46ae-afcd-7f93444141b4 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:23.267674 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-09e435f9-cf30-46ae-afcd-7f93444141b4 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] [instance: c97e472c-540e-4bd5-abaf-d7dadac8c6be] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:23.275741 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-09e435f9-cf30-46ae-afcd-7f93444141b4 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:23.276379 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-09e435f9-cf30-46ae-afcd-7f93444141b4 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:23.277657 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-09e435f9-cf30-46ae-afcd-7f93444141b4 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:23.278274 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-09e435f9-cf30-46ae-afcd-7f93444141b4 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:23.333787 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-119f4654-a9ca-47bd-a19c-444476fe12be tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:23.345616 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-119f4654-a9ca-47bd-a19c-444476fe12be tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306" status: 200 len: 1520 microversion: 2.1 time: 0.247315 May 19 13:33:23.355455 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 131/284] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:23 2022] GET /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306 => generated 1520 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:23.422843 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-09e435f9-cf30-46ae-afcd-7f93444141b4 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11df35c0e4541deaea0494759301a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '510387333865470196f9be30ef62395c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:23.431197 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-09e435f9-cf30-46ae-afcd-7f93444141b4 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] 10.222.0.24 "GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be" status: 200 len: 1357 microversion: 2.1 time: 0.173487 May 19 13:33:23.431197 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 154/285] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:23 2022] GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be => generated 1357 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:33:23.641889 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-bd76f965-3af4-402a-b2e4-e8abbe03a882 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:23.642565 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-bd76f965-3af4-402a-b2e4-e8abbe03a882 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:23.651267 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-bd76f965-3af4-402a-b2e4-e8abbe03a882 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:23.651871 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-bd76f965-3af4-402a-b2e4-e8abbe03a882 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:23.652949 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-bd76f965-3af4-402a-b2e4-e8abbe03a882 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:23.653669 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-bd76f965-3af4-402a-b2e4-e8abbe03a882 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:23.800427 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-bd76f965-3af4-402a-b2e4-e8abbe03a882 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:23.809215 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-bd76f965-3af4-402a-b2e4-e8abbe03a882 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:23.810875 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-bd76f965-3af4-402a-b2e4-e8abbe03a882 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:23.812104 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-bd76f965-3af4-402a-b2e4-e8abbe03a882 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1724 microversion: 2.20 time: 0.175049 May 19 13:33:23.812857 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 132/286] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:33:23 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:33:23.955613 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-80d10a5e-cae1-4b62-9e7f-28ba32ff4957 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:23.956275 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-80d10a5e-cae1-4b62-9e7f-28ba32ff4957 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] [instance: 07e97bb4-e6af-4707-a137-dd83d2887895] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:23.962556 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-80d10a5e-cae1-4b62-9e7f-28ba32ff4957 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:23.962998 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-80d10a5e-cae1-4b62-9e7f-28ba32ff4957 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:23.963794 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-80d10a5e-cae1-4b62-9e7f-28ba32ff4957 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:23.964241 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-80d10a5e-cae1-4b62-9e7f-28ba32ff4957 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:24.109881 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-80d10a5e-cae1-4b62-9e7f-28ba32ff4957 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a8a480afb3438cb269ebd710c78018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26987661f54291b3cf7086b0a1c98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:24.122903 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-80d10a5e-cae1-4b62-9e7f-28ba32ff4957 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] 10.222.0.24 "GET /compute/v2.1/servers/07e97bb4-e6af-4707-a137-dd83d2887895" status: 200 len: 1314 microversion: 2.1 time: 0.171824 May 19 13:33:24.123471 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 155/287] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:23 2022] GET /compute/v2.1/servers/07e97bb4-e6af-4707-a137-dd83d2887895 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:33:24.245975 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-3a008409-50f5-4e29-a026-52d337aab179 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1390882702", "imageRef": "9beb860d-9c3f-4244-80aa-71a9c337a429", "flavorRef": "452", "networks": [{"uuid": "87bf18b1-62e1-4c33-ac80-cb8609461a97"}]}} {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:33:24.362968 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-44402b04-a739-43b1-8adf-1904257d3760 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:24.363562 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-44402b04-a739-43b1-8adf-1904257d3760 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: c4c1abc9-8651-4788-9650-27704ae7e306] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:24.370210 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-44402b04-a739-43b1-8adf-1904257d3760 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:24.370653 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-44402b04-a739-43b1-8adf-1904257d3760 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:24.371875 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-44402b04-a739-43b1-8adf-1904257d3760 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:24.372288 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-44402b04-a739-43b1-8adf-1904257d3760 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:24.525622 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-44402b04-a739-43b1-8adf-1904257d3760 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:24.533708 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-44402b04-a739-43b1-8adf-1904257d3760 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306" status: 200 len: 1520 microversion: 2.1 time: 0.174567 May 19 13:33:24.534279 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 156/288] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:24 2022] GET /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306 => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:33:24.552548 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-5337af03-e73d-4577-8a0b-183577b20009 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:24.553246 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-5337af03-e73d-4577-8a0b-183577b20009 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] [instance: c97e472c-540e-4bd5-abaf-d7dadac8c6be] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:24.560240 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-5337af03-e73d-4577-8a0b-183577b20009 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:24.560719 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-5337af03-e73d-4577-8a0b-183577b20009 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:24.561551 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-5337af03-e73d-4577-8a0b-183577b20009 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:24.561982 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-5337af03-e73d-4577-8a0b-183577b20009 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:24.716964 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-5337af03-e73d-4577-8a0b-183577b20009 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11df35c0e4541deaea0494759301a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '510387333865470196f9be30ef62395c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:24.724890 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-5337af03-e73d-4577-8a0b-183577b20009 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] 10.222.0.24 "GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be" status: 200 len: 1357 microversion: 2.1 time: 0.177488 May 19 13:33:24.725594 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 157/289] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:24 2022] GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be => generated 1357 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:24.830860 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-13d6aba6-626c-4577-8d91-6beed6f8784a tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:24.831777 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-13d6aba6-626c-4577-8d91-6beed6f8784a tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:24.838084 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-13d6aba6-626c-4577-8d91-6beed6f8784a tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:24.838531 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-13d6aba6-626c-4577-8d91-6beed6f8784a tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:24.839365 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-13d6aba6-626c-4577-8d91-6beed6f8784a tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:24.839793 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-13d6aba6-626c-4577-8d91-6beed6f8784a tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:24.860824 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_cell1:SELECT=100 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:33:24.987587 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-13d6aba6-626c-4577-8d91-6beed6f8784a tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:24.995872 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-13d6aba6-626c-4577-8d91-6beed6f8784a tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:24.997432 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-13d6aba6-626c-4577-8d91-6beed6f8784a tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:24.998869 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-13d6aba6-626c-4577-8d91-6beed6f8784a tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1724 microversion: 2.20 time: 0.171952 May 19 13:33:24.999480 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 158/290] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:33:24 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:33:25.141893 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-d7ae7833-c095-431b-adbc-9a4da4551c43 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:25.142491 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-d7ae7833-c095-431b-adbc-9a4da4551c43 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] [instance: 07e97bb4-e6af-4707-a137-dd83d2887895] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:25.148945 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-d7ae7833-c095-431b-adbc-9a4da4551c43 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:25.149392 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-d7ae7833-c095-431b-adbc-9a4da4551c43 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:25.150197 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-d7ae7833-c095-431b-adbc-9a4da4551c43 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:25.150626 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-d7ae7833-c095-431b-adbc-9a4da4551c43 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:25.301815 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-d7ae7833-c095-431b-adbc-9a4da4551c43 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a8a480afb3438cb269ebd710c78018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26987661f54291b3cf7086b0a1c98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:25.309681 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-d7ae7833-c095-431b-adbc-9a4da4551c43 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] 10.222.0.24 "GET /compute/v2.1/servers/07e97bb4-e6af-4707-a137-dd83d2887895" status: 200 len: 1314 microversion: 2.1 time: 0.171796 May 19 13:33:25.310530 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 159/291] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:25 2022] GET /compute/v2.1/servers/07e97bb4-e6af-4707-a137-dd83d2887895 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:33:25.554229 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-572831bb-612d-4c71-bec3-19952923629d tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:25.554765 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-572831bb-612d-4c71-bec3-19952923629d tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: c4c1abc9-8651-4788-9650-27704ae7e306] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:25.561676 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-572831bb-612d-4c71-bec3-19952923629d tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:25.562166 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-572831bb-612d-4c71-bec3-19952923629d tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:25.563019 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-572831bb-612d-4c71-bec3-19952923629d tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:25.563459 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-572831bb-612d-4c71-bec3-19952923629d tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:25.727028 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-572831bb-612d-4c71-bec3-19952923629d tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:25.736861 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-572831bb-612d-4c71-bec3-19952923629d tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306" status: 200 len: 1520 microversion: 2.1 time: 0.186503 May 19 13:33:25.739657 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 160/292] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:25 2022] GET /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306 => generated 1520 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:25.746746 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-cb96c130-5613-4a31-80ac-a22c6000424d tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:25.747565 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-cb96c130-5613-4a31-80ac-a22c6000424d tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] [instance: c97e472c-540e-4bd5-abaf-d7dadac8c6be] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:25.762632 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-cb96c130-5613-4a31-80ac-a22c6000424d tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:25.763180 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-cb96c130-5613-4a31-80ac-a22c6000424d tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:25.763966 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-cb96c130-5613-4a31-80ac-a22c6000424d tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:25.764400 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-cb96c130-5613-4a31-80ac-a22c6000424d tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:26.120261 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-cb96c130-5613-4a31-80ac-a22c6000424d tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11df35c0e4541deaea0494759301a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '510387333865470196f9be30ef62395c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:26.128951 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-cb96c130-5613-4a31-80ac-a22c6000424d tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] 10.222.0.24 "GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be" status: 200 len: 1357 microversion: 2.1 time: 0.389909 May 19 13:33:26.129562 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 161/293] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:25 2022] GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be => generated 1357 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:26.135290 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-bef98202-d603-4a7a-a527-f509198cc590 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:26.135880 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-bef98202-d603-4a7a-a527-f509198cc590 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:26.142439 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-bef98202-d603-4a7a-a527-f509198cc590 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:26.142879 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-bef98202-d603-4a7a-a527-f509198cc590 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:26.143627 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-bef98202-d603-4a7a-a527-f509198cc590 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:26.144046 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-bef98202-d603-4a7a-a527-f509198cc590 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:26.270281 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.network.neutron [None req-3a008409-50f5-4e29-a026-52d337aab179 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] validate_networks() for [('87bf18b1-62e1-4c33-ac80-cb8609461a97', None, None, None, None, None)] {{(pid=120472) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 13:33:26.284465 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-bef98202-d603-4a7a-a527-f509198cc590 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:26.297701 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-bef98202-d603-4a7a-a527-f509198cc590 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:26.299216 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-bef98202-d603-4a7a-a527-f509198cc590 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:26.301522 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-bef98202-d603-4a7a-a527-f509198cc590 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1724 microversion: 2.20 time: 0.170110 May 19 13:33:26.302224 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 162/294] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:33:26 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:33:26.327473 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-9cadde6f-8da3-4357-b122-9b92ebdef435 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:26.328086 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-9cadde6f-8da3-4357-b122-9b92ebdef435 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] [instance: 07e97bb4-e6af-4707-a137-dd83d2887895] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:26.336527 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-9cadde6f-8da3-4357-b122-9b92ebdef435 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:26.336974 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-9cadde6f-8da3-4357-b122-9b92ebdef435 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:26.337858 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-9cadde6f-8da3-4357-b122-9b92ebdef435 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:26.338288 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-9cadde6f-8da3-4357-b122-9b92ebdef435 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:26.496840 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-9cadde6f-8da3-4357-b122-9b92ebdef435 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a8a480afb3438cb269ebd710c78018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26987661f54291b3cf7086b0a1c98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:26.504747 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-9cadde6f-8da3-4357-b122-9b92ebdef435 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] 10.222.0.24 "GET /compute/v2.1/servers/07e97bb4-e6af-4707-a137-dd83d2887895" status: 200 len: 1314 microversion: 2.1 time: 0.181946 May 19 13:33:26.505502 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 163/295] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:26 2022] GET /compute/v2.1/servers/07e97bb4-e6af-4707-a137-dd83d2887895 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:33:26.714486 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.virt.hardware [None req-3a008409-50f5-4e29-a026-52d337aab179 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Flavor limits 0:0:0 {{(pid=120472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 13:33:26.715076 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.virt.hardware [None req-3a008409-50f5-4e29-a026-52d337aab179 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Image limits 0:0:0 {{(pid=120472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 13:33:26.715664 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.virt.hardware [None req-3a008409-50f5-4e29-a026-52d337aab179 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Flavor pref 0:0:0 {{(pid=120472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 13:33:26.716086 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.virt.hardware [None req-3a008409-50f5-4e29-a026-52d337aab179 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Image pref 0:0:0 {{(pid=120472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 13:33:26.716647 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.virt.hardware [None req-3a008409-50f5-4e29-a026-52d337aab179 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 13:33:26.726132 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-3a008409-50f5-4e29-a026-52d337aab179 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:26.726572 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-3a008409-50f5-4e29-a026-52d337aab179 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:26.727350 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-3a008409-50f5-4e29-a026-52d337aab179 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:26.727779 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-3a008409-50f5-4e29-a026-52d337aab179 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:26.745360 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.quota [None req-3a008409-50f5-4e29-a026-52d337aab179 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Getting quotas for project c96a605108ec47a081c60bc8dc16fd8e. Resources: {'instances', 'cores', 'ram'} {{(pid=120472) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 13:33:26.749809 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.quota [None req-3a008409-50f5-4e29-a026-52d337aab179 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Getting quotas for user d26c50b54171491b987ca844091c6e73 and project c96a605108ec47a081c60bc8dc16fd8e. Resources: {'instances', 'cores', 'ram'} {{(pid=120472) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 13:33:26.754877 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-435ad1cb-f4d9-4192-b64c-4ffd6a05bddb tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:26.755501 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-435ad1cb-f4d9-4192-b64c-4ffd6a05bddb tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: c4c1abc9-8651-4788-9650-27704ae7e306] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:26.762094 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-435ad1cb-f4d9-4192-b64c-4ffd6a05bddb tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:26.763063 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-435ad1cb-f4d9-4192-b64c-4ffd6a05bddb tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:26.763902 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-435ad1cb-f4d9-4192-b64c-4ffd6a05bddb tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:26.764340 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-435ad1cb-f4d9-4192-b64c-4ffd6a05bddb tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:26.766376 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-3a008409-50f5-4e29-a026-52d337aab179 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Going to run 1 instances... {{(pid=120472) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 13:33:26.768767 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-3a008409-50f5-4e29-a026-52d337aab179 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] [instance: 3dc7fd1b-e5d5-4f93-bcff-94b90ed75138] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9beb860d-9c3f-4244-80aa-71a9c337a429',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120472) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 13:33:26.818119 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-3a008409-50f5-4e29-a026-52d337aab179 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.575917 May 19 13:33:26.818763 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 133/296] 10.222.0.24 () {60 vars in 1146 bytes} [Thu May 19 13:33:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 2577 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 13:33:26.829137 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-353c56c2-5c24-45bc-b077-01102f5bac3a tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:26.830025 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-353c56c2-5c24-45bc-b077-01102f5bac3a tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] [instance: 3dc7fd1b-e5d5-4f93-bcff-94b90ed75138] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:26.888549 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-353c56c2-5c24-45bc-b077-01102f5bac3a tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26c50b54171491b987ca844091c6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96a605108ec47a081c60bc8dc16fd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:26.897310 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-353c56c2-5c24-45bc-b077-01102f5bac3a tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] 10.222.0.24 "GET /compute/v2.1/servers/3dc7fd1b-e5d5-4f93-bcff-94b90ed75138" status: 200 len: 1219 microversion: 2.1 time: 0.072305 May 19 13:33:26.897934 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 134/297] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:26 2022] GET /compute/v2.1/servers/3dc7fd1b-e5d5-4f93-bcff-94b90ed75138 => generated 1219 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:26.925238 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-435ad1cb-f4d9-4192-b64c-4ffd6a05bddb tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:26.932905 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-435ad1cb-f4d9-4192-b64c-4ffd6a05bddb tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306" status: 200 len: 1520 microversion: 2.1 time: 0.181991 May 19 13:33:26.933608 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 164/298] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:26 2022] GET /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306 => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:27.150838 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-b0961810-3ba6-4856-beaf-e08bfa654785 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:27.151960 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-b0961810-3ba6-4856-beaf-e08bfa654785 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] [instance: c97e472c-540e-4bd5-abaf-d7dadac8c6be] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:27.164096 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-b0961810-3ba6-4856-beaf-e08bfa654785 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:27.165393 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-b0961810-3ba6-4856-beaf-e08bfa654785 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:27.167824 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-b0961810-3ba6-4856-beaf-e08bfa654785 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:27.168851 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-b0961810-3ba6-4856-beaf-e08bfa654785 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:27.320057 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-44de3142-74c7-4ab4-8191-1b7e8a300c0a tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:27.320661 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-44de3142-74c7-4ab4-8191-1b7e8a300c0a tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:27.327205 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-44de3142-74c7-4ab4-8191-1b7e8a300c0a tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:27.327604 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-44de3142-74c7-4ab4-8191-1b7e8a300c0a tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:27.328583 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-44de3142-74c7-4ab4-8191-1b7e8a300c0a tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:27.329016 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-44de3142-74c7-4ab4-8191-1b7e8a300c0a tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:27.336548 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-b0961810-3ba6-4856-beaf-e08bfa654785 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11df35c0e4541deaea0494759301a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '510387333865470196f9be30ef62395c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:27.344895 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-b0961810-3ba6-4856-beaf-e08bfa654785 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] 10.222.0.24 "GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be" status: 200 len: 1357 microversion: 2.1 time: 0.200818 May 19 13:33:27.345510 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 135/299] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:27 2022] GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be => generated 1357 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:27.491600 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-44de3142-74c7-4ab4-8191-1b7e8a300c0a tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:27.500056 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-44de3142-74c7-4ab4-8191-1b7e8a300c0a tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:27.501650 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-44de3142-74c7-4ab4-8191-1b7e8a300c0a tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:27.502803 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-44de3142-74c7-4ab4-8191-1b7e8a300c0a tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1724 microversion: 2.20 time: 0.186739 May 19 13:33:27.503884 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 165/300] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:33:27 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1724 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 13:33:27.522696 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-d7e43196-ac33-47fb-be5d-daad61c1e1f3 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:27.523303 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-d7e43196-ac33-47fb-be5d-daad61c1e1f3 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] [instance: 07e97bb4-e6af-4707-a137-dd83d2887895] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:27.529793 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-d7e43196-ac33-47fb-be5d-daad61c1e1f3 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:27.530249 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-d7e43196-ac33-47fb-be5d-daad61c1e1f3 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:27.531018 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-d7e43196-ac33-47fb-be5d-daad61c1e1f3 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:27.531456 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-d7e43196-ac33-47fb-be5d-daad61c1e1f3 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:27.917524 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-a1633a01-b509-47e4-b9b1-40834504e7d7 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:27.918114 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-a1633a01-b509-47e4-b9b1-40834504e7d7 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] [instance: 3dc7fd1b-e5d5-4f93-bcff-94b90ed75138] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:27.924549 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-a1633a01-b509-47e4-b9b1-40834504e7d7 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:27.924914 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-a1633a01-b509-47e4-b9b1-40834504e7d7 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:27.925727 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-a1633a01-b509-47e4-b9b1-40834504e7d7 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:27.926153 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-a1633a01-b509-47e4-b9b1-40834504e7d7 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:27.993426 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-a1633a01-b509-47e4-b9b1-40834504e7d7 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26c50b54171491b987ca844091c6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96a605108ec47a081c60bc8dc16fd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:28.010905 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-a1633a01-b509-47e4-b9b1-40834504e7d7 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] 10.222.0.24 "GET /compute/v2.1/servers/3dc7fd1b-e5d5-4f93-bcff-94b90ed75138" status: 200 len: 1223 microversion: 2.1 time: 0.099358 May 19 13:33:28.011501 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 166/301] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:27 2022] GET /compute/v2.1/servers/3dc7fd1b-e5d5-4f93-bcff-94b90ed75138 => generated 1223 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:28.015105 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-d7e43196-ac33-47fb-be5d-daad61c1e1f3 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a8a480afb3438cb269ebd710c78018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26987661f54291b3cf7086b0a1c98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:28.019683 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-45e6a999-74d9-4411-9515-e6385f4fc420 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:28.020284 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-45e6a999-74d9-4411-9515-e6385f4fc420 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: c4c1abc9-8651-4788-9650-27704ae7e306] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:28.022990 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-d7e43196-ac33-47fb-be5d-daad61c1e1f3 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] 10.222.0.24 "GET /compute/v2.1/servers/07e97bb4-e6af-4707-a137-dd83d2887895" status: 200 len: 1314 microversion: 2.1 time: 0.504038 May 19 13:33:28.025820 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 136/302] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:27 2022] GET /compute/v2.1/servers/07e97bb4-e6af-4707-a137-dd83d2887895 => generated 1314 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:28.037250 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-45e6a999-74d9-4411-9515-e6385f4fc420 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:28.038115 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-45e6a999-74d9-4411-9515-e6385f4fc420 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:28.039047 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-45e6a999-74d9-4411-9515-e6385f4fc420 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:28.039477 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-45e6a999-74d9-4411-9515-e6385f4fc420 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:28.211480 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-45e6a999-74d9-4411-9515-e6385f4fc420 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:28.225271 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-45e6a999-74d9-4411-9515-e6385f4fc420 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306" status: 200 len: 1500 microversion: 2.1 time: 0.209023 May 19 13:33:28.237767 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 167/303] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:28 2022] GET /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306 => generated 1500 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:28.244607 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-6c1b0a64-d307-4bdf-ac26-b21a934794ac tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1dd3213b-6f1d-431e-a021-a6f7ced12e3a"}} {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:33:28.248434 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-6c1b0a64-d307-4bdf-ac26-b21a934794ac tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: c4c1abc9-8651-4788-9650-27704ae7e306] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:28.255743 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-6c1b0a64-d307-4bdf-ac26-b21a934794ac tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:28.256198 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-6c1b0a64-d307-4bdf-ac26-b21a934794ac tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:28.256977 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-6c1b0a64-d307-4bdf-ac26-b21a934794ac tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:28.257599 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-6c1b0a64-d307-4bdf-ac26-b21a934794ac tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:28.291977 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.wsgi [None req-6c1b0a64-d307-4bdf-ac26-b21a934794ac tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] HTTP exception thrown: Cannot 'attach_volume' instance c4c1abc9-8651-4788-9650-27704ae7e306 while it is in vm_state rescued May 19 13:33:28.294056 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-6c1b0a64-d307-4bdf-ac26-b21a934794ac tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Request method failure captured: May 19 13:33:28.294056 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: request: POST /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306/os-volume_attachments HTTP/1.1 May 19 13:33:28.294056 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Accept: application/json May 19 13:33:28.294056 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Accept-Encoding: identity May 19 13:33:28.294056 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Connection: close May 19 13:33:28.294056 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Content-Length: 74 May 19 13:33:28.294056 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Content-Type: application/json May 19 13:33:28.294056 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Host: 10.222.0.24 May 19 13:33:28.294056 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Openstack-System-Scope: None May 19 13:33:28.294056 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: User-Agent: python-urllib3/1.26.9 May 19 13:33:28.294056 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Auth-Token: gAAAAABihka28w_XrUfaOtaJo3uOu_VKP25qoARCt1sMNKJyTv9Zs2UdBFAMxpQQTuZSPm5_OGrEsu9-FHYT7rVvy0PjGuvfYySPIV0FbQR2CrL-a-e1bGrkGoxusbmks-C9euLBSRZS_Ru4AaJkLiaaCt15rraZYv-Ku8n3RqspqC_JYm_SeyE May 19 13:33:28.294056 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Domain-Id: None May 19 13:33:28.294056 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Domain-Name: None May 19 13:33:28.294056 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Identity-Status: Confirmed May 19 13:33:28.294056 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Is-Admin-Project: True May 19 13:33:28.294056 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Domain-Id: default May 19 13:33:28.294056 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Domain-Name: Default May 19 13:33:28.294056 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Id: 63972a518bb048d19dd070eb9ac85445 May 19 13:33:28.294056 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-217359763 May 19 13:33:28.294056 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Role: reader,member May 19 13:33:28.294056 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Roles: reader,member May 19 13:33:28.295367 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/63972a518bb048d19dd070eb9ac85445"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/63972a518bb048d19dd070eb9ac85445"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_63972a518bb048d19dd070eb9ac85445", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/63972a518bb048d19dd070eb9ac85445"}]}] May 19 13:33:28.295367 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant: tempest-ServerRescueNegativeTestJSON-217359763 May 19 13:33:28.295367 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant-Id: 63972a518bb048d19dd070eb9ac85445 May 19 13:33:28.295367 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-217359763 May 19 13:33:28.295367 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User: tempest-ServerRescueNegativeTestJSON-217359763-project May 19 13:33:28.295367 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Domain-Id: default May 19 13:33:28.295367 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Domain-Name: Default May 19 13:33:28.295367 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Id: 2d3b91bfd0304cc793e3ad52c9b9e865 May 19 13:33:28.295367 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Name: tempest-ServerRescueNegativeTestJSON-217359763-project May 19 13:33:28.295367 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: May 19 13:33:28.295367 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: {"volumeAttachment": {"volumeId": "1dd3213b-6f1d-431e-a021-a6f7ced12e3a"}} May 19 13:33:28.295367 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: method: > May 19 13:33:28.296087 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: exception: Cannot 'attach_volume' instance c4c1abc9-8651-4788-9650-27704ae7e306 while it is in vm_state rescued May 19 13:33:28.296087 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: action_args: {'server_id': 'c4c1abc9-8651-4788-9650-27704ae7e306', 'body': {'volumeAttachment': {'volumeId': '1dd3213b-6f1d-431e-a021-a6f7ced12e3a'}}} May 19 13:33:28.296087 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:33:28.296087 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:33:28.296087 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 19 13:33:28.296087 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 19 13:33:28.296087 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 19 13:33:28.296087 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 13:33:28.296087 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 19 13:33:28.296087 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 19 13:33:28.296087 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c4c1abc9-8651-4788-9650-27704ae7e306 in vm_state rescued. Cannot attach_volume while the instance is in this state. May 19 13:33:28.296087 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:33:28.296087 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:33:28.296087 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:33:28.296087 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:33:28.296087 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:33:28.296087 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:33:28.296087 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:33:28.296087 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:33:28.297346 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:33:28.297346 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:33:28.297346 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 13:33:28.297346 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 13:33:28.297346 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 13:33:28.297346 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 13:33:28.297346 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 13:33:28.297346 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 13:33:28.297346 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 19 13:33:28.297346 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 19 13:33:28.297346 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 19 13:33:28.297346 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 19 13:33:28.297346 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance c4c1abc9-8651-4788-9650-27704ae7e306 while it is in vm_state rescued May 19 13:33:28.297346 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:33:28.297346 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:33:28.297346 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:33:28.297346 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:33:28.297346 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:33:28.297346 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:33:28.301450 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:33:28.301450 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:33:28.301450 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance c4c1abc9-8651-4788-9650-27704ae7e306 while it is in vm_state rescued May 19 13:33:28.301450 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:33:28.301450 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-6c1b0a64-d307-4bdf-ac26-b21a934794ac tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Returning 409 to user: Cannot 'attach_volume' instance c4c1abc9-8651-4788-9650-27704ae7e306 while it is in vm_state rescued {{(pid=120472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:33:28.301450 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-6c1b0a64-d307-4bdf-ac26-b21a934794ac tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "POST /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.055101 May 19 13:33:28.301450 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 137/304] 10.222.0.24 () {60 vars in 1322 bytes} [Thu May 19 13:33:28 2022] POST /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306/os-volume_attachments => generated 152 bytes in 59 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 19 13:33:28.308822 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-88296ba8-fa5a-4491-a009-a3ad79be602c tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:33:28.310625 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-88296ba8-fa5a-4491-a009-a3ad79be602c tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: c4c1abc9-8651-4788-9650-27704ae7e306] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:28.318976 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-88296ba8-fa5a-4491-a009-a3ad79be602c tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:28.319137 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-88296ba8-fa5a-4491-a009-a3ad79be602c tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:28.319892 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-88296ba8-fa5a-4491-a009-a3ad79be602c tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:28.320329 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-88296ba8-fa5a-4491-a009-a3ad79be602c tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:28.362609 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-5bcf7212-965a-4b9f-a621-74836955f1ee tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:28.363208 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-5bcf7212-965a-4b9f-a621-74836955f1ee tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] [instance: c97e472c-540e-4bd5-abaf-d7dadac8c6be] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:28.384291 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-5bcf7212-965a-4b9f-a621-74836955f1ee tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:28.384767 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-5bcf7212-965a-4b9f-a621-74836955f1ee tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:28.385624 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-5bcf7212-965a-4b9f-a621-74836955f1ee tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:28.386260 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-5bcf7212-965a-4b9f-a621-74836955f1ee tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:28.476441 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-88296ba8-fa5a-4491-a009-a3ad79be602c tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "POST /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306/action" status: 202 len: 0 microversion: 2.1 time: 0.165616 May 19 13:33:28.477703 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 168/305] 10.222.0.24 () {60 vars in 1277 bytes} [Thu May 19 13:33:28 2022] POST /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 13:33:28.486333 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-ec5b5741-967f-4581-b7d3-18fab3130f9f tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:28.487388 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-ec5b5741-967f-4581-b7d3-18fab3130f9f tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: c4c1abc9-8651-4788-9650-27704ae7e306] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:28.494177 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-ec5b5741-967f-4581-b7d3-18fab3130f9f tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:28.495227 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-ec5b5741-967f-4581-b7d3-18fab3130f9f tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:28.496650 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-ec5b5741-967f-4581-b7d3-18fab3130f9f tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:28.497246 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-ec5b5741-967f-4581-b7d3-18fab3130f9f tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:28.644015 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-ec5b5741-967f-4581-b7d3-18fab3130f9f tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:28.652691 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-ec5b5741-967f-4581-b7d3-18fab3130f9f tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306" status: 200 len: 1508 microversion: 2.1 time: 0.170504 May 19 13:33:28.653297 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 169/306] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:28 2022] GET /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306 => generated 1508 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:33:28.668229 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-ad01ab27-a6f6-49c4-a783-41a9171d7fdb tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:28.668625 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-ad01ab27-a6f6-49c4-a783-41a9171d7fdb tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:28.675797 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-ad01ab27-a6f6-49c4-a783-41a9171d7fdb tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:28.676232 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-ad01ab27-a6f6-49c4-a783-41a9171d7fdb tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:28.677061 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-ad01ab27-a6f6-49c4-a783-41a9171d7fdb tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:28.677632 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-ad01ab27-a6f6-49c4-a783-41a9171d7fdb tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:28.705994 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-5bcf7212-965a-4b9f-a621-74836955f1ee tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11df35c0e4541deaea0494759301a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '510387333865470196f9be30ef62395c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:28.714435 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-5bcf7212-965a-4b9f-a621-74836955f1ee tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] 10.222.0.24 "GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be" status: 200 len: 1357 microversion: 2.1 time: 0.356302 May 19 13:33:28.715155 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 138/307] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:28 2022] GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be => generated 1357 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:33:28.876459 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-ad01ab27-a6f6-49c4-a783-41a9171d7fdb tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:28.889507 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-ad01ab27-a6f6-49c4-a783-41a9171d7fdb tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:28.890838 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-ad01ab27-a6f6-49c4-a783-41a9171d7fdb tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:28.892216 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-ad01ab27-a6f6-49c4-a783-41a9171d7fdb tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1745 microversion: 2.20 time: 0.237980 May 19 13:33:28.893444 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 170/308] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:33:28 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1745 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:33:28.957263 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [req-65c23824-03d0-4574-9984-a3077fe8406f req-a994fe16-7efd-499c-8013-41c0ec99d628 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c97e472c-540e-4bd5-abaf-d7dadac8c6be", "tag": "97ed1b45-3101-4569-a101-5346f9044405"}]} {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:33:28.992860 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [req-65c23824-03d0-4574-9984-a3077fe8406f req-a994fe16-7efd-499c-8013-41c0ec99d628 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:28.993649 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [req-65c23824-03d0-4574-9984-a3077fe8406f req-a994fe16-7efd-499c-8013-41c0ec99d628 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:29.008091 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.compute.server_external_events [req-65c23824-03d0-4574-9984-a3077fe8406f req-a994fe16-7efd-499c-8013-41c0ec99d628 service nova] Creating event network-changed:97ed1b45-3101-4569-a101-5346f9044405 for instance c97e472c-540e-4bd5-abaf-d7dadac8c6be on hv-cinder-84112 May 19 13:33:29.029525 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-56489144-4a6f-4c90-9dc3-69d1c35e3d95 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:29.030425 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-56489144-4a6f-4c90-9dc3-69d1c35e3d95 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] [instance: 3dc7fd1b-e5d5-4f93-bcff-94b90ed75138] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:29.041262 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [req-65c23824-03d0-4574-9984-a3077fe8406f req-a994fe16-7efd-499c-8013-41c0ec99d628 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086476 May 19 13:33:29.044520 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 139/309] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:33:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:33:29.047107 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-56489144-4a6f-4c90-9dc3-69d1c35e3d95 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:29.048597 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-56489144-4a6f-4c90-9dc3-69d1c35e3d95 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:29.050147 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-56489144-4a6f-4c90-9dc3-69d1c35e3d95 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:29.051941 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-56489144-4a6f-4c90-9dc3-69d1c35e3d95 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:29.060577 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-f69ae5a9-213f-4947-b350-ba8984fdc9e4 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:29.062109 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-f69ae5a9-213f-4947-b350-ba8984fdc9e4 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] [instance: 07e97bb4-e6af-4707-a137-dd83d2887895] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:29.077675 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-f69ae5a9-213f-4947-b350-ba8984fdc9e4 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:29.078117 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-f69ae5a9-213f-4947-b350-ba8984fdc9e4 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:29.078917 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-f69ae5a9-213f-4947-b350-ba8984fdc9e4 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:29.079303 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-f69ae5a9-213f-4947-b350-ba8984fdc9e4 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:29.201946 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-56489144-4a6f-4c90-9dc3-69d1c35e3d95 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26c50b54171491b987ca844091c6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96a605108ec47a081c60bc8dc16fd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:29.209957 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-56489144-4a6f-4c90-9dc3-69d1c35e3d95 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] 10.222.0.24 "GET /compute/v2.1/servers/3dc7fd1b-e5d5-4f93-bcff-94b90ed75138" status: 200 len: 1289 microversion: 2.1 time: 0.185060 May 19 13:33:29.210949 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 171/310] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:29 2022] GET /compute/v2.1/servers/3dc7fd1b-e5d5-4f93-bcff-94b90ed75138 => generated 1289 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:29.362327 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-f69ae5a9-213f-4947-b350-ba8984fdc9e4 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a8a480afb3438cb269ebd710c78018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26987661f54291b3cf7086b0a1c98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:29.372793 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-f69ae5a9-213f-4947-b350-ba8984fdc9e4 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] 10.222.0.24 "GET /compute/v2.1/servers/07e97bb4-e6af-4707-a137-dd83d2887895" status: 200 len: 1314 microversion: 2.1 time: 0.324746 May 19 13:33:29.373384 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 140/311] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:29 2022] GET /compute/v2.1/servers/07e97bb4-e6af-4707-a137-dd83d2887895 => generated 1314 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:29.671656 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-89a3b4e2-ea58-45fb-82d7-026defd6538c tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:29.672233 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-89a3b4e2-ea58-45fb-82d7-026defd6538c tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: c4c1abc9-8651-4788-9650-27704ae7e306] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:29.679140 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-89a3b4e2-ea58-45fb-82d7-026defd6538c tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:29.679603 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-89a3b4e2-ea58-45fb-82d7-026defd6538c tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:29.680415 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-89a3b4e2-ea58-45fb-82d7-026defd6538c tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:29.680846 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-89a3b4e2-ea58-45fb-82d7-026defd6538c tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:29.732676 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-159aacdf-0718-4116-8fc0-531c1e545e49 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:29.733650 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-159aacdf-0718-4116-8fc0-531c1e545e49 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] [instance: c97e472c-540e-4bd5-abaf-d7dadac8c6be] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:29.747332 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-159aacdf-0718-4116-8fc0-531c1e545e49 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:29.748086 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-159aacdf-0718-4116-8fc0-531c1e545e49 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:29.749146 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-159aacdf-0718-4116-8fc0-531c1e545e49 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:29.749677 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-159aacdf-0718-4116-8fc0-531c1e545e49 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:29.890741 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-89a3b4e2-ea58-45fb-82d7-026defd6538c tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:29.898743 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-89a3b4e2-ea58-45fb-82d7-026defd6538c tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306" status: 200 len: 1508 microversion: 2.1 time: 0.231529 May 19 13:33:29.908595 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 172/312] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:29 2022] GET /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306 => generated 1508 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:29.916085 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-95a5f69a-8dd9-43e4-a689-d85107343bf9 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:29.916814 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-95a5f69a-8dd9-43e4-a689-d85107343bf9 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:29.925111 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-95a5f69a-8dd9-43e4-a689-d85107343bf9 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:29.925730 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-95a5f69a-8dd9-43e4-a689-d85107343bf9 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:29.926641 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-95a5f69a-8dd9-43e4-a689-d85107343bf9 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:29.927076 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-95a5f69a-8dd9-43e4-a689-d85107343bf9 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:30.048146 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-159aacdf-0718-4116-8fc0-531c1e545e49 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11df35c0e4541deaea0494759301a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '510387333865470196f9be30ef62395c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:30.057370 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-159aacdf-0718-4116-8fc0-531c1e545e49 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] 10.222.0.24 "GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be" status: 200 len: 1357 microversion: 2.1 time: 0.328959 May 19 13:33:30.058327 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 141/313] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:29 2022] GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be => generated 1357 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:30.117432 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-95a5f69a-8dd9-43e4-a689-d85107343bf9 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:30.125526 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-95a5f69a-8dd9-43e4-a689-d85107343bf9 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:30.127196 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-95a5f69a-8dd9-43e4-a689-d85107343bf9 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:30.128347 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-95a5f69a-8dd9-43e4-a689-d85107343bf9 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1745 microversion: 2.20 time: 0.218155 May 19 13:33:30.128900 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 173/314] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:33:29 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1745 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 13:33:30.228859 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-d90778a0-e6fc-4971-8a5f-b31e71fe6d13 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:30.229390 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-d90778a0-e6fc-4971-8a5f-b31e71fe6d13 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] [instance: 3dc7fd1b-e5d5-4f93-bcff-94b90ed75138] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:30.236802 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-d90778a0-e6fc-4971-8a5f-b31e71fe6d13 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:30.237504 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-d90778a0-e6fc-4971-8a5f-b31e71fe6d13 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:30.238438 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-d90778a0-e6fc-4971-8a5f-b31e71fe6d13 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:30.239068 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-d90778a0-e6fc-4971-8a5f-b31e71fe6d13 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:30.395095 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-c334209b-6390-47aa-b227-5d41c7fe13ae tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:30.395823 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-c334209b-6390-47aa-b227-5d41c7fe13ae tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] [instance: 07e97bb4-e6af-4707-a137-dd83d2887895] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:30.405936 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-c334209b-6390-47aa-b227-5d41c7fe13ae tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:30.406375 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-c334209b-6390-47aa-b227-5d41c7fe13ae tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:30.407147 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-c334209b-6390-47aa-b227-5d41c7fe13ae tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:30.408355 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-c334209b-6390-47aa-b227-5d41c7fe13ae tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:30.413832 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:33:30.609676 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-c334209b-6390-47aa-b227-5d41c7fe13ae tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a8a480afb3438cb269ebd710c78018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26987661f54291b3cf7086b0a1c98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:30.617929 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-c334209b-6390-47aa-b227-5d41c7fe13ae tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] 10.222.0.24 "GET /compute/v2.1/servers/07e97bb4-e6af-4707-a137-dd83d2887895" status: 200 len: 1314 microversion: 2.1 time: 0.229578 May 19 13:33:30.618620 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 174/315] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:30 2022] GET /compute/v2.1/servers/07e97bb4-e6af-4707-a137-dd83d2887895 => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:30.921879 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-117ed730-f0d3-4e63-b02d-bf5ae3970f98 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:30.923392 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-117ed730-f0d3-4e63-b02d-bf5ae3970f98 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: c4c1abc9-8651-4788-9650-27704ae7e306] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:30.932753 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-117ed730-f0d3-4e63-b02d-bf5ae3970f98 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:30.933194 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-117ed730-f0d3-4e63-b02d-bf5ae3970f98 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:30.934600 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-117ed730-f0d3-4e63-b02d-bf5ae3970f98 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:30.935392 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-117ed730-f0d3-4e63-b02d-bf5ae3970f98 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:31.007938 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-d90778a0-e6fc-4971-8a5f-b31e71fe6d13 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26c50b54171491b987ca844091c6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96a605108ec47a081c60bc8dc16fd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:31.016950 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-d90778a0-e6fc-4971-8a5f-b31e71fe6d13 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] 10.222.0.24 "GET /compute/v2.1/servers/3dc7fd1b-e5d5-4f93-bcff-94b90ed75138" status: 200 len: 1319 microversion: 2.1 time: 0.793184 May 19 13:33:31.018054 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 142/316] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:30 2022] GET /compute/v2.1/servers/3dc7fd1b-e5d5-4f93-bcff-94b90ed75138 => generated 1319 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:31.075124 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-99c01852-1556-47af-bd26-2405370e3602 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:31.075749 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-99c01852-1556-47af-bd26-2405370e3602 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] [instance: c97e472c-540e-4bd5-abaf-d7dadac8c6be] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:31.086384 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-99c01852-1556-47af-bd26-2405370e3602 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:31.087120 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-99c01852-1556-47af-bd26-2405370e3602 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:31.088069 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-99c01852-1556-47af-bd26-2405370e3602 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:31.088655 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-99c01852-1556-47af-bd26-2405370e3602 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:31.188653 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-117ed730-f0d3-4e63-b02d-bf5ae3970f98 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:31.197107 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-117ed730-f0d3-4e63-b02d-bf5ae3970f98 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306" status: 200 len: 1508 microversion: 2.1 time: 0.283844 May 19 13:33:31.207317 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 175/317] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:30 2022] GET /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306 => generated 1508 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:31.212149 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-6e9cfead-8449-4b67-9e20-87b0acf37f0b tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:31.212751 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-6e9cfead-8449-4b67-9e20-87b0acf37f0b tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:31.219417 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-6e9cfead-8449-4b67-9e20-87b0acf37f0b tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:31.219895 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-6e9cfead-8449-4b67-9e20-87b0acf37f0b tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:31.220657 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-6e9cfead-8449-4b67-9e20-87b0acf37f0b tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:31.221088 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-6e9cfead-8449-4b67-9e20-87b0acf37f0b tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:31.356838 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-99c01852-1556-47af-bd26-2405370e3602 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11df35c0e4541deaea0494759301a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '510387333865470196f9be30ef62395c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:31.365628 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-99c01852-1556-47af-bd26-2405370e3602 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] 10.222.0.24 "GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be" status: 200 len: 1357 microversion: 2.1 time: 0.294294 May 19 13:33:31.365822 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-6e9cfead-8449-4b67-9e20-87b0acf37f0b tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:31.366389 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 143/318] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:31 2022] GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be => generated 1357 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:33:31.374975 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-6e9cfead-8449-4b67-9e20-87b0acf37f0b tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:31.376497 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-6e9cfead-8449-4b67-9e20-87b0acf37f0b tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:31.377693 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-6e9cfead-8449-4b67-9e20-87b0acf37f0b tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1745 microversion: 2.20 time: 0.169296 May 19 13:33:31.378265 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 176/319] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:33:31 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1745 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:33:31.634983 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-eacb9397-20e1-4272-bf3e-9727de31dba9 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:31.635622 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-eacb9397-20e1-4272-bf3e-9727de31dba9 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] [instance: 07e97bb4-e6af-4707-a137-dd83d2887895] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:31.643399 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-eacb9397-20e1-4272-bf3e-9727de31dba9 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:31.643838 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-eacb9397-20e1-4272-bf3e-9727de31dba9 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:31.644608 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-eacb9397-20e1-4272-bf3e-9727de31dba9 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:31.645031 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-eacb9397-20e1-4272-bf3e-9727de31dba9 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:31.874648 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-eacb9397-20e1-4272-bf3e-9727de31dba9 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a8a480afb3438cb269ebd710c78018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26987661f54291b3cf7086b0a1c98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:31.882180 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-eacb9397-20e1-4272-bf3e-9727de31dba9 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] 10.222.0.24 "GET /compute/v2.1/servers/07e97bb4-e6af-4707-a137-dd83d2887895" status: 200 len: 1314 microversion: 2.1 time: 0.251373 May 19 13:33:31.882761 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 144/320] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:31 2022] GET /compute/v2.1/servers/07e97bb4-e6af-4707-a137-dd83d2887895 => generated 1314 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:31.895830 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [req-3543a316-6a64-43af-b3d5-d56fb25e2074 req-68aecd82-a496-41fc-94d2-c7635097d372 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3dc7fd1b-e5d5-4f93-bcff-94b90ed75138", "tag": "e53ff309-b270-4145-8e81-9fc7f9777b9d"}]} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:33:31.904266 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-3543a316-6a64-43af-b3d5-d56fb25e2074 req-68aecd82-a496-41fc-94d2-c7635097d372 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:31.904698 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-3543a316-6a64-43af-b3d5-d56fb25e2074 req-68aecd82-a496-41fc-94d2-c7635097d372 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:31.916906 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.compute.server_external_events [req-3543a316-6a64-43af-b3d5-d56fb25e2074 req-68aecd82-a496-41fc-94d2-c7635097d372 service nova] Creating event network-changed:e53ff309-b270-4145-8e81-9fc7f9777b9d for instance 3dc7fd1b-e5d5-4f93-bcff-94b90ed75138 on hv-cinder-84112 May 19 13:33:31.921988 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [req-3543a316-6a64-43af-b3d5-d56fb25e2074 req-68aecd82-a496-41fc-94d2-c7635097d372 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029760 May 19 13:33:31.922557 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 177/321] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:33:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:33:32.035477 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-27d8bf3a-29ac-4527-8387-3cbe68175296 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:32.036065 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-27d8bf3a-29ac-4527-8387-3cbe68175296 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] [instance: 3dc7fd1b-e5d5-4f93-bcff-94b90ed75138] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:32.042764 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-27d8bf3a-29ac-4527-8387-3cbe68175296 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:32.043204 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-27d8bf3a-29ac-4527-8387-3cbe68175296 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:32.043999 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-27d8bf3a-29ac-4527-8387-3cbe68175296 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:32.044418 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-27d8bf3a-29ac-4527-8387-3cbe68175296 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:32.183390 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-27d8bf3a-29ac-4527-8387-3cbe68175296 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26c50b54171491b987ca844091c6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96a605108ec47a081c60bc8dc16fd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:32.191359 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-27d8bf3a-29ac-4527-8387-3cbe68175296 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] 10.222.0.24 "GET /compute/v2.1/servers/3dc7fd1b-e5d5-4f93-bcff-94b90ed75138" status: 200 len: 1319 microversion: 2.1 time: 0.159739 May 19 13:33:32.191923 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 145/322] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:32 2022] GET /compute/v2.1/servers/3dc7fd1b-e5d5-4f93-bcff-94b90ed75138 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:32.216703 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-6eb7d65c-8d59-4bbc-95b1-03fa69cce8c5 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:32.217454 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-6eb7d65c-8d59-4bbc-95b1-03fa69cce8c5 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: c4c1abc9-8651-4788-9650-27704ae7e306] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:32.224542 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-6eb7d65c-8d59-4bbc-95b1-03fa69cce8c5 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:32.225471 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-6eb7d65c-8d59-4bbc-95b1-03fa69cce8c5 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:32.226625 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-6eb7d65c-8d59-4bbc-95b1-03fa69cce8c5 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:32.227127 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-6eb7d65c-8d59-4bbc-95b1-03fa69cce8c5 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:32.373251 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-6eb7d65c-8d59-4bbc-95b1-03fa69cce8c5 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:32.383795 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-6eb7d65c-8d59-4bbc-95b1-03fa69cce8c5 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306" status: 200 len: 1508 microversion: 2.1 time: 0.172151 May 19 13:33:32.384371 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 178/323] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:32 2022] GET /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306 => generated 1508 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:32.386322 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-ffac3e4e-e8ed-40ab-af08-f3bcc4c8455c tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:32.386933 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-ffac3e4e-e8ed-40ab-af08-f3bcc4c8455c tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] [instance: c97e472c-540e-4bd5-abaf-d7dadac8c6be] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:32.394878 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-ffac3e4e-e8ed-40ab-af08-f3bcc4c8455c tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:32.395332 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-ffac3e4e-e8ed-40ab-af08-f3bcc4c8455c tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:32.396091 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-ffac3e4e-e8ed-40ab-af08-f3bcc4c8455c tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:32.396522 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-ffac3e4e-e8ed-40ab-af08-f3bcc4c8455c tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:32.397121 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-181b897f-5499-4b9c-9368-a46310923cd9 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:32.397765 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-181b897f-5499-4b9c-9368-a46310923cd9 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:32.404839 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-181b897f-5499-4b9c-9368-a46310923cd9 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:32.405271 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-181b897f-5499-4b9c-9368-a46310923cd9 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:32.406262 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-181b897f-5499-4b9c-9368-a46310923cd9 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:32.406697 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-181b897f-5499-4b9c-9368-a46310923cd9 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:32.539172 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-ffac3e4e-e8ed-40ab-af08-f3bcc4c8455c tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11df35c0e4541deaea0494759301a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '510387333865470196f9be30ef62395c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:32.548247 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-ffac3e4e-e8ed-40ab-af08-f3bcc4c8455c tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] 10.222.0.24 "GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be" status: 200 len: 1357 microversion: 2.1 time: 0.168508 May 19 13:33:32.548955 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 146/324] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:32 2022] GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be => generated 1357 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:33:32.553264 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [req-5ea3e83d-62f5-409e-a673-0bffa7d84a00 req-ac97dbd5-e644-4ba1-8531-6804a6a61794 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "323322ec-2e2e-424b-a411-8a34069bcf10", "name": "network-vif-plugged", "status": "completed", "tag": "1ae6b782-184e-4357-ab26-9a0648e0a6a3"}]} {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:33:32.557479 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-181b897f-5499-4b9c-9368-a46310923cd9 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:32.562688 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [req-5ea3e83d-62f5-409e-a673-0bffa7d84a00 req-ac97dbd5-e644-4ba1-8531-6804a6a61794 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:32.563234 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [req-5ea3e83d-62f5-409e-a673-0bffa7d84a00 req-ac97dbd5-e644-4ba1-8531-6804a6a61794 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:32.567638 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-181b897f-5499-4b9c-9368-a46310923cd9 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:32.569154 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-181b897f-5499-4b9c-9368-a46310923cd9 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:32.570494 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-181b897f-5499-4b9c-9368-a46310923cd9 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1745 microversion: 2.20 time: 0.178614 May 19 13:33:32.571254 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 179/325] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:33:32 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1745 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:33:32.579361 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.compute.server_external_events [req-5ea3e83d-62f5-409e-a673-0bffa7d84a00 req-ac97dbd5-e644-4ba1-8531-6804a6a61794 service nova] Creating event network-vif-plugged:1ae6b782-184e-4357-ab26-9a0648e0a6a3 for instance 323322ec-2e2e-424b-a411-8a34069bcf10 on hv-cinder-84112 May 19 13:33:32.588646 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [req-5ea3e83d-62f5-409e-a673-0bffa7d84a00 req-ac97dbd5-e644-4ba1-8531-6804a6a61794 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038550 May 19 13:33:32.589262 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 147/326] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:33:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:33:32.901456 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-a6216200-cbd0-4ae8-87ff-d1a68ae39d72 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:32.902253 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-a6216200-cbd0-4ae8-87ff-d1a68ae39d72 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] [instance: 07e97bb4-e6af-4707-a137-dd83d2887895] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:32.910900 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-a6216200-cbd0-4ae8-87ff-d1a68ae39d72 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:32.911480 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-a6216200-cbd0-4ae8-87ff-d1a68ae39d72 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:32.912747 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-a6216200-cbd0-4ae8-87ff-d1a68ae39d72 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:32.913370 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-a6216200-cbd0-4ae8-87ff-d1a68ae39d72 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:33.059593 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-a6216200-cbd0-4ae8-87ff-d1a68ae39d72 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a8a480afb3438cb269ebd710c78018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26987661f54291b3cf7086b0a1c98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:33.070981 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-a6216200-cbd0-4ae8-87ff-d1a68ae39d72 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] 10.222.0.24 "GET /compute/v2.1/servers/07e97bb4-e6af-4707-a137-dd83d2887895" status: 200 len: 1314 microversion: 2.1 time: 0.175269 May 19 13:33:33.071812 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 180/327] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:32 2022] GET /compute/v2.1/servers/07e97bb4-e6af-4707-a137-dd83d2887895 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:33.210051 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-56ca1e52-7019-4451-be53-9adce5a272e4 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:33.210818 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-56ca1e52-7019-4451-be53-9adce5a272e4 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] [instance: 3dc7fd1b-e5d5-4f93-bcff-94b90ed75138] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:33.218536 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-56ca1e52-7019-4451-be53-9adce5a272e4 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:33.218994 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-56ca1e52-7019-4451-be53-9adce5a272e4 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:33.220009 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-56ca1e52-7019-4451-be53-9adce5a272e4 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:33.220264 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-56ca1e52-7019-4451-be53-9adce5a272e4 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:33.358383 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-56ca1e52-7019-4451-be53-9adce5a272e4 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26c50b54171491b987ca844091c6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96a605108ec47a081c60bc8dc16fd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:33.366250 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-56ca1e52-7019-4451-be53-9adce5a272e4 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] 10.222.0.24 "GET /compute/v2.1/servers/3dc7fd1b-e5d5-4f93-bcff-94b90ed75138" status: 200 len: 1319 microversion: 2.1 time: 0.161363 May 19 13:33:33.366788 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 148/328] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:33 2022] GET /compute/v2.1/servers/3dc7fd1b-e5d5-4f93-bcff-94b90ed75138 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:33.401198 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-c23c02ce-37e6-45e7-ad9a-c932be2e70b9 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:33.401822 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-c23c02ce-37e6-45e7-ad9a-c932be2e70b9 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: c4c1abc9-8651-4788-9650-27704ae7e306] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:33.409127 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-c23c02ce-37e6-45e7-ad9a-c932be2e70b9 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:33.409609 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-c23c02ce-37e6-45e7-ad9a-c932be2e70b9 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:33.410376 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-c23c02ce-37e6-45e7-ad9a-c932be2e70b9 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:33.410808 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-c23c02ce-37e6-45e7-ad9a-c932be2e70b9 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:33.547768 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-c23c02ce-37e6-45e7-ad9a-c932be2e70b9 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:33.555584 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-c23c02ce-37e6-45e7-ad9a-c932be2e70b9 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306" status: 200 len: 1508 microversion: 2.1 time: 0.158289 May 19 13:33:33.556129 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 181/329] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:33 2022] GET /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306 => generated 1508 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:33.564455 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-39925d30-015b-4728-922d-d7251d2848a9 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:33.565177 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-39925d30-015b-4728-922d-d7251d2848a9 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] [instance: c97e472c-540e-4bd5-abaf-d7dadac8c6be] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:33.571464 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-39925d30-015b-4728-922d-d7251d2848a9 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:33.571907 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-39925d30-015b-4728-922d-d7251d2848a9 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:33.572662 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-39925d30-015b-4728-922d-d7251d2848a9 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:33.573087 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-39925d30-015b-4728-922d-d7251d2848a9 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:33.598039 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-9b7ac947-1899-425a-8f0c-983f9d3db8af tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:33.598289 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-9b7ac947-1899-425a-8f0c-983f9d3db8af tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:33.609964 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-9b7ac947-1899-425a-8f0c-983f9d3db8af tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:33.610412 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-9b7ac947-1899-425a-8f0c-983f9d3db8af tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:33.611679 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-9b7ac947-1899-425a-8f0c-983f9d3db8af tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:33.611679 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-9b7ac947-1899-425a-8f0c-983f9d3db8af tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:33.753362 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-39925d30-015b-4728-922d-d7251d2848a9 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11df35c0e4541deaea0494759301a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '510387333865470196f9be30ef62395c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:33.755132 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-9b7ac947-1899-425a-8f0c-983f9d3db8af tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:33.760923 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-39925d30-015b-4728-922d-d7251d2848a9 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] 10.222.0.24 "GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be" status: 200 len: 1357 microversion: 2.1 time: 0.200395 May 19 13:33:33.761501 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 149/330] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:33 2022] GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be => generated 1357 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:33.763491 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-9b7ac947-1899-425a-8f0c-983f9d3db8af tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:33.765031 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-9b7ac947-1899-425a-8f0c-983f9d3db8af tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:33.766297 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-9b7ac947-1899-425a-8f0c-983f9d3db8af tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1745 microversion: 2.20 time: 0.172615 May 19 13:33:33.766832 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 182/331] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:33:33 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1745 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 13:33:34.088259 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-797a0123-c0b3-4b1a-a008-f5fc2ee6e4d2 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:34.088925 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-797a0123-c0b3-4b1a-a008-f5fc2ee6e4d2 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] [instance: 07e97bb4-e6af-4707-a137-dd83d2887895] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:34.095563 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-797a0123-c0b3-4b1a-a008-f5fc2ee6e4d2 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:34.096002 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-797a0123-c0b3-4b1a-a008-f5fc2ee6e4d2 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:34.096744 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-797a0123-c0b3-4b1a-a008-f5fc2ee6e4d2 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:34.097180 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-797a0123-c0b3-4b1a-a008-f5fc2ee6e4d2 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:34.261312 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-797a0123-c0b3-4b1a-a008-f5fc2ee6e4d2 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a8a480afb3438cb269ebd710c78018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26987661f54291b3cf7086b0a1c98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:34.266382 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_cell1:SELECT=100 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:33:34.273097 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-797a0123-c0b3-4b1a-a008-f5fc2ee6e4d2 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] 10.222.0.24 "GET /compute/v2.1/servers/07e97bb4-e6af-4707-a137-dd83d2887895" status: 200 len: 1314 microversion: 2.1 time: 0.188706 May 19 13:33:34.273877 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 150/332] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:34 2022] GET /compute/v2.1/servers/07e97bb4-e6af-4707-a137-dd83d2887895 => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:34.387079 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-fa61c3c1-9e2f-423b-a9f3-7135bfaed10e tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:34.389021 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-fa61c3c1-9e2f-423b-a9f3-7135bfaed10e tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] [instance: 3dc7fd1b-e5d5-4f93-bcff-94b90ed75138] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:34.400798 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-fa61c3c1-9e2f-423b-a9f3-7135bfaed10e tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:34.401950 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-fa61c3c1-9e2f-423b-a9f3-7135bfaed10e tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:34.404138 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-fa61c3c1-9e2f-423b-a9f3-7135bfaed10e tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:34.404709 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-fa61c3c1-9e2f-423b-a9f3-7135bfaed10e tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:34.562613 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-fa61c3c1-9e2f-423b-a9f3-7135bfaed10e tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26c50b54171491b987ca844091c6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96a605108ec47a081c60bc8dc16fd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:34.581774 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-707fb377-a0fa-49c2-a4ac-ce41b612e08e tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:34.581774 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-707fb377-a0fa-49c2-a4ac-ce41b612e08e tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: c4c1abc9-8651-4788-9650-27704ae7e306] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:34.586578 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-fa61c3c1-9e2f-423b-a9f3-7135bfaed10e tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] 10.222.0.24 "GET /compute/v2.1/servers/3dc7fd1b-e5d5-4f93-bcff-94b90ed75138" status: 200 len: 1319 microversion: 2.1 time: 0.206622 May 19 13:33:34.590153 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 183/333] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:34 2022] GET /compute/v2.1/servers/3dc7fd1b-e5d5-4f93-bcff-94b90ed75138 => generated 1319 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:34.595374 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-707fb377-a0fa-49c2-a4ac-ce41b612e08e tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:34.596137 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-707fb377-a0fa-49c2-a4ac-ce41b612e08e tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:34.597195 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-707fb377-a0fa-49c2-a4ac-ce41b612e08e tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:34.597865 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-707fb377-a0fa-49c2-a4ac-ce41b612e08e tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:34.780828 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-ecbb911a-9759-477c-8245-8a573c4d047a tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:34.781579 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-ecbb911a-9759-477c-8245-8a573c4d047a tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] [instance: c97e472c-540e-4bd5-abaf-d7dadac8c6be] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:34.788333 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-ecbb911a-9759-477c-8245-8a573c4d047a tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:34.788788 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-ecbb911a-9759-477c-8245-8a573c4d047a tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:34.789609 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-ecbb911a-9759-477c-8245-8a573c4d047a tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:34.790032 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-ecbb911a-9759-477c-8245-8a573c4d047a tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:34.818863 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-707fb377-a0fa-49c2-a4ac-ce41b612e08e tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:34.827906 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-707fb377-a0fa-49c2-a4ac-ce41b612e08e tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306" status: 200 len: 1508 microversion: 2.1 time: 0.257976 May 19 13:33:34.828472 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 151/334] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:34 2022] GET /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306 => generated 1508 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:33:34.833269 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-fc4e43fb-a3bd-43f6-ae59-13bb461ddca0 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:34.833820 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-fc4e43fb-a3bd-43f6-ae59-13bb461ddca0 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:34.840757 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-fc4e43fb-a3bd-43f6-ae59-13bb461ddca0 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:34.840757 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-fc4e43fb-a3bd-43f6-ae59-13bb461ddca0 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:34.841622 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-fc4e43fb-a3bd-43f6-ae59-13bb461ddca0 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:34.842045 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-fc4e43fb-a3bd-43f6-ae59-13bb461ddca0 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:35.070121 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-fc4e43fb-a3bd-43f6-ae59-13bb461ddca0 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:35.085189 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-fc4e43fb-a3bd-43f6-ae59-13bb461ddca0 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:35.086637 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-fc4e43fb-a3bd-43f6-ae59-13bb461ddca0 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:35.087814 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-fc4e43fb-a3bd-43f6-ae59-13bb461ddca0 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1740 microversion: 2.20 time: 0.258430 May 19 13:33:35.088407 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 152/335] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:33:34 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1740 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:33:35.137922 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-ecbb911a-9759-477c-8245-8a573c4d047a tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11df35c0e4541deaea0494759301a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '510387333865470196f9be30ef62395c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:35.145724 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-ecbb911a-9759-477c-8245-8a573c4d047a tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] 10.222.0.24 "GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be" status: 200 len: 1357 microversion: 2.1 time: 0.370808 May 19 13:33:35.146306 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 184/336] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:34 2022] GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be => generated 1357 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:33:35.291664 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-346d91ef-3688-4935-b6fb-28cf0d2f0d5b tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:35.292599 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-346d91ef-3688-4935-b6fb-28cf0d2f0d5b tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] [instance: 07e97bb4-e6af-4707-a137-dd83d2887895] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:35.299777 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-346d91ef-3688-4935-b6fb-28cf0d2f0d5b tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:35.300216 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-346d91ef-3688-4935-b6fb-28cf0d2f0d5b tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:35.300965 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-346d91ef-3688-4935-b6fb-28cf0d2f0d5b tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:35.301401 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-346d91ef-3688-4935-b6fb-28cf0d2f0d5b tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:35.451645 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-346d91ef-3688-4935-b6fb-28cf0d2f0d5b tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a8a480afb3438cb269ebd710c78018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26987661f54291b3cf7086b0a1c98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:35.459231 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-346d91ef-3688-4935-b6fb-28cf0d2f0d5b tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] 10.222.0.24 "GET /compute/v2.1/servers/07e97bb4-e6af-4707-a137-dd83d2887895" status: 200 len: 1314 microversion: 2.1 time: 0.171945 May 19 13:33:35.459799 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 153/337] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:35 2022] GET /compute/v2.1/servers/07e97bb4-e6af-4707-a137-dd83d2887895 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:35.604355 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-44ee409a-f930-49f6-868e-7d6d4798e947 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:35.605032 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-44ee409a-f930-49f6-868e-7d6d4798e947 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] [instance: 3dc7fd1b-e5d5-4f93-bcff-94b90ed75138] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:35.612158 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-44ee409a-f930-49f6-868e-7d6d4798e947 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:35.612703 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-44ee409a-f930-49f6-868e-7d6d4798e947 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:35.613572 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-44ee409a-f930-49f6-868e-7d6d4798e947 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:35.614091 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-44ee409a-f930-49f6-868e-7d6d4798e947 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:35.846686 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-44ee409a-f930-49f6-868e-7d6d4798e947 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26c50b54171491b987ca844091c6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96a605108ec47a081c60bc8dc16fd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:35.847855 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-0d015122-6d86-43ae-a631-0a1ad521f1db tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:35.848572 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-0d015122-6d86-43ae-a631-0a1ad521f1db tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: c4c1abc9-8651-4788-9650-27704ae7e306] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:35.856614 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-0d015122-6d86-43ae-a631-0a1ad521f1db tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:35.857053 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-44ee409a-f930-49f6-868e-7d6d4798e947 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] 10.222.0.24 "GET /compute/v2.1/servers/3dc7fd1b-e5d5-4f93-bcff-94b90ed75138" status: 200 len: 1319 microversion: 2.1 time: 0.256400 May 19 13:33:35.857688 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 185/338] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:35 2022] GET /compute/v2.1/servers/3dc7fd1b-e5d5-4f93-bcff-94b90ed75138 => generated 1319 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:35.863564 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-0d015122-6d86-43ae-a631-0a1ad521f1db tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:35.865769 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-0d015122-6d86-43ae-a631-0a1ad521f1db tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:35.866392 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-0d015122-6d86-43ae-a631-0a1ad521f1db tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:36.065820 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-0d015122-6d86-43ae-a631-0a1ad521f1db tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:36.085889 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-0d015122-6d86-43ae-a631-0a1ad521f1db tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306" status: 200 len: 1514 microversion: 2.1 time: 0.243008 May 19 13:33:36.087710 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 154/339] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:35 2022] GET /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306 => generated 1514 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:36.115711 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-b68c560c-62f6-4166-a8d6-8a356ceaab8f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:36.118610 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-b68c560c-62f6-4166-a8d6-8a356ceaab8f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:36.130551 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-b68c560c-62f6-4166-a8d6-8a356ceaab8f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:36.131007 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-b68c560c-62f6-4166-a8d6-8a356ceaab8f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:36.131777 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-b68c560c-62f6-4166-a8d6-8a356ceaab8f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:36.132207 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-b68c560c-62f6-4166-a8d6-8a356ceaab8f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:36.165284 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-5ca812de-8d74-4eb7-8d40-1660bab53ff7 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:36.165284 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-5ca812de-8d74-4eb7-8d40-1660bab53ff7 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] [instance: c97e472c-540e-4bd5-abaf-d7dadac8c6be] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:36.185367 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-5ca812de-8d74-4eb7-8d40-1660bab53ff7 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:36.186000 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-5ca812de-8d74-4eb7-8d40-1660bab53ff7 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:36.187019 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-5ca812de-8d74-4eb7-8d40-1660bab53ff7 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:36.189300 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-5ca812de-8d74-4eb7-8d40-1660bab53ff7 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:36.409455 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-5ca812de-8d74-4eb7-8d40-1660bab53ff7 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11df35c0e4541deaea0494759301a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '510387333865470196f9be30ef62395c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:36.420279 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-5ca812de-8d74-4eb7-8d40-1660bab53ff7 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] 10.222.0.24 "GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be" status: 200 len: 1357 microversion: 2.1 time: 0.260807 May 19 13:33:36.421513 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 155/340] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:36 2022] GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be => generated 1357 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:33:36.477383 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-ecae872f-872f-4bef-86cc-aab97b62e525 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:36.478427 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-ecae872f-872f-4bef-86cc-aab97b62e525 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] [instance: 07e97bb4-e6af-4707-a137-dd83d2887895] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:36.496584 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-ecae872f-872f-4bef-86cc-aab97b62e525 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:36.499682 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-b68c560c-62f6-4166-a8d6-8a356ceaab8f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:36.503407 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-ecae872f-872f-4bef-86cc-aab97b62e525 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:36.507053 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-ecae872f-872f-4bef-86cc-aab97b62e525 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:36.507501 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-ecae872f-872f-4bef-86cc-aab97b62e525 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:36.528835 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-b68c560c-62f6-4166-a8d6-8a356ceaab8f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:36.531593 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-b68c560c-62f6-4166-a8d6-8a356ceaab8f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:36.533950 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-b68c560c-62f6-4166-a8d6-8a356ceaab8f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1740 microversion: 2.20 time: 0.431336 May 19 13:33:36.534808 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 186/341] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:33:36 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1740 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:33:36.736553 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_cell0:SELECT=2 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:33:36.842530 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-ecae872f-872f-4bef-86cc-aab97b62e525 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a8a480afb3438cb269ebd710c78018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26987661f54291b3cf7086b0a1c98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:36.852427 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-ecae872f-872f-4bef-86cc-aab97b62e525 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] 10.222.0.24 "GET /compute/v2.1/servers/07e97bb4-e6af-4707-a137-dd83d2887895" status: 200 len: 1314 microversion: 2.1 time: 0.380635 May 19 13:33:36.864109 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 156/342] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:36 2022] GET /compute/v2.1/servers/07e97bb4-e6af-4707-a137-dd83d2887895 => generated 1314 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:33:36.875554 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-ba815f3a-1761-4729-9667-1d888e438cd8 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:36.876149 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-ba815f3a-1761-4729-9667-1d888e438cd8 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] [instance: 3dc7fd1b-e5d5-4f93-bcff-94b90ed75138] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:36.879705 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [req-128b35eb-f042-42a0-89bf-715fa37a2a62 req-5b809b8e-e73e-441d-b229-065a0e8ff7eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c97e472c-540e-4bd5-abaf-d7dadac8c6be", "name": "network-vif-plugged", "status": "completed", "tag": "97ed1b45-3101-4569-a101-5346f9044405"}]} {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:33:36.890623 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-ba815f3a-1761-4729-9667-1d888e438cd8 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:36.891531 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-ba815f3a-1761-4729-9667-1d888e438cd8 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:36.892655 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_cell0:SELECT=8 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:33:36.892980 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-ba815f3a-1761-4729-9667-1d888e438cd8 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:36.893182 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-ba815f3a-1761-4729-9667-1d888e438cd8 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:36.898848 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [req-128b35eb-f042-42a0-89bf-715fa37a2a62 req-5b809b8e-e73e-441d-b229-065a0e8ff7eb service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:36.899492 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [req-128b35eb-f042-42a0-89bf-715fa37a2a62 req-5b809b8e-e73e-441d-b229-065a0e8ff7eb service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:36.916238 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.compute.server_external_events [req-128b35eb-f042-42a0-89bf-715fa37a2a62 req-5b809b8e-e73e-441d-b229-065a0e8ff7eb service nova] Creating event network-vif-plugged:97ed1b45-3101-4569-a101-5346f9044405 for instance c97e472c-540e-4bd5-abaf-d7dadac8c6be on hv-cinder-84112 May 19 13:33:36.926755 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [req-128b35eb-f042-42a0-89bf-715fa37a2a62 req-5b809b8e-e73e-441d-b229-065a0e8ff7eb service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052288 May 19 13:33:36.933034 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 157/343] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:33:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:33:37.452008 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-5de388e1-beed-41f2-ab8f-e0560f13bae6 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:37.453079 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-5de388e1-beed-41f2-ab8f-e0560f13bae6 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] [instance: c97e472c-540e-4bd5-abaf-d7dadac8c6be] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:37.498432 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-5de388e1-beed-41f2-ab8f-e0560f13bae6 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:37.499508 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-5de388e1-beed-41f2-ab8f-e0560f13bae6 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:37.502379 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-5de388e1-beed-41f2-ab8f-e0560f13bae6 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:37.505334 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-5de388e1-beed-41f2-ab8f-e0560f13bae6 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:37.552209 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-ba815f3a-1761-4729-9667-1d888e438cd8 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26c50b54171491b987ca844091c6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96a605108ec47a081c60bc8dc16fd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:37.571204 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-ba815f3a-1761-4729-9667-1d888e438cd8 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] 10.222.0.24 "GET /compute/v2.1/servers/3dc7fd1b-e5d5-4f93-bcff-94b90ed75138" status: 200 len: 1319 microversion: 2.1 time: 0.700468 May 19 13:33:37.571866 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 187/344] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:36 2022] GET /compute/v2.1/servers/3dc7fd1b-e5d5-4f93-bcff-94b90ed75138 => generated 1319 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:37.588015 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-8bbf5056-772f-445e-8694-5a73f75edaea tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:37.596309 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-8bbf5056-772f-445e-8694-5a73f75edaea tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:37.614307 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-8bbf5056-772f-445e-8694-5a73f75edaea tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:37.614756 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-8bbf5056-772f-445e-8694-5a73f75edaea tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:37.615531 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-8bbf5056-772f-445e-8694-5a73f75edaea tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:37.615984 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-8bbf5056-772f-445e-8694-5a73f75edaea tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:37.830163 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-5de388e1-beed-41f2-ab8f-e0560f13bae6 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11df35c0e4541deaea0494759301a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '510387333865470196f9be30ef62395c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:37.840994 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-5de388e1-beed-41f2-ab8f-e0560f13bae6 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] 10.222.0.24 "GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be" status: 200 len: 1357 microversion: 2.1 time: 0.406834 May 19 13:33:37.841992 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 158/345] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:37 2022] GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be => generated 1357 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:33:37.849222 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-f67bce43-0700-4268-901f-17043e11a07a tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Action: 'create', calling method: .version_select at 0x7f7c2a821e50>, body: {"keypair": {"name": "tempest-keypair-768143211", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDCPg1Cjy00QWyVbmyMWQG2szr2Gjhj8ymU+sS0o9e+xtYIepSzlVedOHx9l+ApQKAZ4HQMhCo/q2fIsp8VDsLhTZ5wS/f3CE3sWPZx9i3+rR01WnSN2q2wCtnJen/f4IA=="}} {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:33:37.865483 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.quota [None req-f67bce43-0700-4268-901f-17043e11a07a tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Getting quotas for project 63972a518bb048d19dd070eb9ac85445. Resources: {'key_pairs'} {{(pid=120472) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 13:33:37.870084 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.quota [None req-f67bce43-0700-4268-901f-17043e11a07a tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Getting quotas for user 2d3b91bfd0304cc793e3ad52c9b9e865 and project 63972a518bb048d19dd070eb9ac85445. Resources: {'key_pairs'} {{(pid=120472) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 13:33:37.911255 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-f67bce43-0700-4268-901f-17043e11a07a tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.067878 May 19 13:33:37.912159 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 159/346] 10.222.0.24 () {60 vars in 1158 bytes} [Thu May 19 13:33:37 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:33:37.923417 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-8b36d5c0-c509-40fe-aae7-c38b9f630fc3 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:37.924054 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-8b36d5c0-c509-40fe-aae7-c38b9f630fc3 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] [instance: 07e97bb4-e6af-4707-a137-dd83d2887895] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:37.927103 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:33:37.935664 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-8b36d5c0-c509-40fe-aae7-c38b9f630fc3 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:37.936343 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-8b36d5c0-c509-40fe-aae7-c38b9f630fc3 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:37.937488 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-8b36d5c0-c509-40fe-aae7-c38b9f630fc3 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:37.938206 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-8b36d5c0-c509-40fe-aae7-c38b9f630fc3 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:37.988670 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-8bbf5056-772f-445e-8694-5a73f75edaea tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:37.997704 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-8bbf5056-772f-445e-8694-5a73f75edaea tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:38.000620 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-8bbf5056-772f-445e-8694-5a73f75edaea tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:38.002157 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-8bbf5056-772f-445e-8694-5a73f75edaea tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1740 microversion: 2.20 time: 0.428246 May 19 13:33:38.014976 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 188/347] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:33:37 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1740 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:33:38.260975 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-8b36d5c0-c509-40fe-aae7-c38b9f630fc3 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a8a480afb3438cb269ebd710c78018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26987661f54291b3cf7086b0a1c98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:38.277628 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-8b36d5c0-c509-40fe-aae7-c38b9f630fc3 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] 10.222.0.24 "GET /compute/v2.1/servers/07e97bb4-e6af-4707-a137-dd83d2887895" status: 200 len: 1314 microversion: 2.1 time: 0.364457 May 19 13:33:38.278421 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 160/348] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:37 2022] GET /compute/v2.1/servers/07e97bb4-e6af-4707-a137-dd83d2887895 => generated 1314 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:38.588595 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-ff3fb86c-68a4-4aa8-9c4f-936b06d1b4aa tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:38.589193 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-ff3fb86c-68a4-4aa8-9c4f-936b06d1b4aa tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] [instance: 3dc7fd1b-e5d5-4f93-bcff-94b90ed75138] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:38.607768 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-ff3fb86c-68a4-4aa8-9c4f-936b06d1b4aa tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:38.608512 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-ff3fb86c-68a4-4aa8-9c4f-936b06d1b4aa tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:38.609467 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-ff3fb86c-68a4-4aa8-9c4f-936b06d1b4aa tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:38.610049 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-ff3fb86c-68a4-4aa8-9c4f-936b06d1b4aa tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:38.859934 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-6546f35a-9256-4125-b88f-45509f25335f tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:38.860751 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-6546f35a-9256-4125-b88f-45509f25335f tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] [instance: c97e472c-540e-4bd5-abaf-d7dadac8c6be] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:38.879351 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-6546f35a-9256-4125-b88f-45509f25335f tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:38.879924 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-6546f35a-9256-4125-b88f-45509f25335f tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:38.880711 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-6546f35a-9256-4125-b88f-45509f25335f tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:38.881140 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-6546f35a-9256-4125-b88f-45509f25335f tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:38.904116 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-ff3fb86c-68a4-4aa8-9c4f-936b06d1b4aa tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26c50b54171491b987ca844091c6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96a605108ec47a081c60bc8dc16fd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:38.937112 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-ff3fb86c-68a4-4aa8-9c4f-936b06d1b4aa tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] 10.222.0.24 "GET /compute/v2.1/servers/3dc7fd1b-e5d5-4f93-bcff-94b90ed75138" status: 200 len: 1319 microversion: 2.1 time: 0.352533 May 19 13:33:38.950896 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 189/349] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:38 2022] GET /compute/v2.1/servers/3dc7fd1b-e5d5-4f93-bcff-94b90ed75138 => generated 1319 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:38.961231 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [req-fd198980-24d0-44fe-8bdd-cf6c955345a7 req-d01b95eb-e335-4793-bd61-d9150b72e3cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07e97bb4-e6af-4707-a137-dd83d2887895", "name": "network-vif-plugged", "status": "completed", "tag": "482e497d-dc94-47c6-8992-021c75b27d64"}]} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:33:38.974928 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-fd198980-24d0-44fe-8bdd-cf6c955345a7 req-d01b95eb-e335-4793-bd61-d9150b72e3cd service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:38.975742 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-fd198980-24d0-44fe-8bdd-cf6c955345a7 req-d01b95eb-e335-4793-bd61-d9150b72e3cd service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:38.992079 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.compute.server_external_events [req-fd198980-24d0-44fe-8bdd-cf6c955345a7 req-d01b95eb-e335-4793-bd61-d9150b72e3cd service nova] Creating event network-vif-plugged:482e497d-dc94-47c6-8992-021c75b27d64 for instance 07e97bb4-e6af-4707-a137-dd83d2887895 on hv-cinder-84112 May 19 13:33:39.001106 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [req-fd198980-24d0-44fe-8bdd-cf6c955345a7 req-d01b95eb-e335-4793-bd61-d9150b72e3cd service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048516 May 19 13:33:39.006523 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 190/350] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:33:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:33:39.023469 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-3966ae85-31c2-4046-be4b-d6c25b2206f9 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:39.024720 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-3966ae85-31c2-4046-be4b-d6c25b2206f9 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:39.033246 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-3966ae85-31c2-4046-be4b-d6c25b2206f9 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:39.034691 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-3966ae85-31c2-4046-be4b-d6c25b2206f9 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:39.035728 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-3966ae85-31c2-4046-be4b-d6c25b2206f9 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:39.036371 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-3966ae85-31c2-4046-be4b-d6c25b2206f9 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:39.290242 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-3966ae85-31c2-4046-be4b-d6c25b2206f9 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:39.305798 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-3966ae85-31c2-4046-be4b-d6c25b2206f9 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:39.310597 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-3966ae85-31c2-4046-be4b-d6c25b2206f9 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:39.313264 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-3966ae85-31c2-4046-be4b-d6c25b2206f9 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1740 microversion: 2.20 time: 0.295048 May 19 13:33:39.314175 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 191/351] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:33:39 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1740 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:33:39.321589 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-3044db78-b882-4b6c-8383-c8d38c722f2f tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:39.323164 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-3044db78-b882-4b6c-8383-c8d38c722f2f tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] [instance: 07e97bb4-e6af-4707-a137-dd83d2887895] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:39.333003 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-3044db78-b882-4b6c-8383-c8d38c722f2f tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:39.333656 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-3044db78-b882-4b6c-8383-c8d38c722f2f tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:39.334818 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-3044db78-b882-4b6c-8383-c8d38c722f2f tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:39.335388 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-3044db78-b882-4b6c-8383-c8d38c722f2f tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:39.341616 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_cell1:SELECT=100 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:33:39.400667 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-6546f35a-9256-4125-b88f-45509f25335f tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11df35c0e4541deaea0494759301a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '510387333865470196f9be30ef62395c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:39.409440 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-6546f35a-9256-4125-b88f-45509f25335f tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] 10.222.0.24 "GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be" status: 200 len: 1357 microversion: 2.1 time: 0.554044 May 19 13:33:39.412906 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 161/352] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:38 2022] GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be => generated 1357 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:39.578517 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-3044db78-b882-4b6c-8383-c8d38c722f2f tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a8a480afb3438cb269ebd710c78018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26987661f54291b3cf7086b0a1c98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:39.588982 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-3044db78-b882-4b6c-8383-c8d38c722f2f tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] 10.222.0.24 "GET /compute/v2.1/servers/07e97bb4-e6af-4707-a137-dd83d2887895" status: 200 len: 1314 microversion: 2.1 time: 0.272760 May 19 13:33:39.599629 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 192/353] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:39 2022] GET /compute/v2.1/servers/07e97bb4-e6af-4707-a137-dd83d2887895 => generated 1314 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:39.954057 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-883d18fe-f43a-469a-96af-bac8d9153440 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:39.954679 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-883d18fe-f43a-469a-96af-bac8d9153440 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] [instance: 3dc7fd1b-e5d5-4f93-bcff-94b90ed75138] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:39.963421 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-883d18fe-f43a-469a-96af-bac8d9153440 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:39.963858 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-883d18fe-f43a-469a-96af-bac8d9153440 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:39.968625 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-883d18fe-f43a-469a-96af-bac8d9153440 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:39.969065 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-883d18fe-f43a-469a-96af-bac8d9153440 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:40.173263 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-062c5c28-cb44-4588-aba6-43d7f2fc975d tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2145290196", "imageRef": "9beb860d-9c3f-4244-80aa-71a9c337a429", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a42ef65b-f8fc-4078-973d-4d38cc62962d"}], "security_groups": [{"name": "tempest-securitygroup--1229670465"}], "key_name": "tempest-keypair-768143211", "user_data": "}} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:33:40.275280 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-883d18fe-f43a-469a-96af-bac8d9153440 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26c50b54171491b987ca844091c6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96a605108ec47a081c60bc8dc16fd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:40.289347 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-883d18fe-f43a-469a-96af-bac8d9153440 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] 10.222.0.24 "GET /compute/v2.1/servers/3dc7fd1b-e5d5-4f93-bcff-94b90ed75138" status: 200 len: 1319 microversion: 2.1 time: 0.339064 May 19 13:33:40.298375 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 162/354] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:39 2022] GET /compute/v2.1/servers/3dc7fd1b-e5d5-4f93-bcff-94b90ed75138 => generated 1319 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:40.334242 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-fdd4d666-35fb-45d8-89bf-70bbc601bba4 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:40.335480 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-fdd4d666-35fb-45d8-89bf-70bbc601bba4 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:40.347876 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-fdd4d666-35fb-45d8-89bf-70bbc601bba4 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:40.350029 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-fdd4d666-35fb-45d8-89bf-70bbc601bba4 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:40.351539 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-fdd4d666-35fb-45d8-89bf-70bbc601bba4 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:40.352236 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-fdd4d666-35fb-45d8-89bf-70bbc601bba4 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:40.356228 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.network.neutron [None req-062c5c28-cb44-4588-aba6-43d7f2fc975d tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] validate_networks() for [('a42ef65b-f8fc-4078-973d-4d38cc62962d', None, None, None, None, None)] {{(pid=120471) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 13:33:40.522272 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-fdd4d666-35fb-45d8-89bf-70bbc601bba4 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:40.534773 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-fdd4d666-35fb-45d8-89bf-70bbc601bba4 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:40.538945 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-fdd4d666-35fb-45d8-89bf-70bbc601bba4 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:40.540387 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-fdd4d666-35fb-45d8-89bf-70bbc601bba4 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1740 microversion: 2.20 time: 0.212435 May 19 13:33:40.542018 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 163/355] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:33:40 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1740 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:33:40.548103 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-6ffff028-a7d7-4815-9c51-e6ab054b501f tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:40.548895 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-6ffff028-a7d7-4815-9c51-e6ab054b501f tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] [instance: c97e472c-540e-4bd5-abaf-d7dadac8c6be] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:40.557464 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-6ffff028-a7d7-4815-9c51-e6ab054b501f tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:40.558278 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-6ffff028-a7d7-4815-9c51-e6ab054b501f tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:40.559323 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-6ffff028-a7d7-4815-9c51-e6ab054b501f tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:40.559982 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-6ffff028-a7d7-4815-9c51-e6ab054b501f tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:40.738198 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-6ffff028-a7d7-4815-9c51-e6ab054b501f tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11df35c0e4541deaea0494759301a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '510387333865470196f9be30ef62395c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:40.749628 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-6ffff028-a7d7-4815-9c51-e6ab054b501f tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] 10.222.0.24 "GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be" status: 200 len: 1548 microversion: 2.1 time: 0.205422 May 19 13:33:40.750632 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 164/356] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:40 2022] GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be => generated 1548 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:40.755954 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-9e02c59c-b01f-4cdd-8d3f-2e3c38f73a1b tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:40.756898 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-9e02c59c-b01f-4cdd-8d3f-2e3c38f73a1b tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] [instance: 07e97bb4-e6af-4707-a137-dd83d2887895] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:40.775237 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-9e02c59c-b01f-4cdd-8d3f-2e3c38f73a1b tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:40.778277 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-9e02c59c-b01f-4cdd-8d3f-2e3c38f73a1b tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:40.780410 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-9e02c59c-b01f-4cdd-8d3f-2e3c38f73a1b tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:40.780971 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-9e02c59c-b01f-4cdd-8d3f-2e3c38f73a1b tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:40.927250 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.virt.hardware [None req-062c5c28-cb44-4588-aba6-43d7f2fc975d tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Flavor limits 0:0:0 {{(pid=120471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 13:33:40.927666 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.virt.hardware [None req-062c5c28-cb44-4588-aba6-43d7f2fc975d tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Image limits 0:0:0 {{(pid=120471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 13:33:40.928131 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.virt.hardware [None req-062c5c28-cb44-4588-aba6-43d7f2fc975d tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Flavor pref 0:0:0 {{(pid=120471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 13:33:40.928541 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.virt.hardware [None req-062c5c28-cb44-4588-aba6-43d7f2fc975d tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Image pref 0:0:0 {{(pid=120471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 13:33:40.928946 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.virt.hardware [None req-062c5c28-cb44-4588-aba6-43d7f2fc975d tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 13:33:40.943973 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-062c5c28-cb44-4588-aba6-43d7f2fc975d tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:40.945083 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-062c5c28-cb44-4588-aba6-43d7f2fc975d tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:40.946139 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-062c5c28-cb44-4588-aba6-43d7f2fc975d tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:40.946751 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-062c5c28-cb44-4588-aba6-43d7f2fc975d tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:40.965474 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.quota [None req-062c5c28-cb44-4588-aba6-43d7f2fc975d tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Getting quotas for project 63972a518bb048d19dd070eb9ac85445. Resources: {'instances', 'cores', 'ram'} {{(pid=120471) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 13:33:40.970377 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.quota [None req-062c5c28-cb44-4588-aba6-43d7f2fc975d tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Getting quotas for user 2d3b91bfd0304cc793e3ad52c9b9e865 and project 63972a518bb048d19dd070eb9ac85445. Resources: {'instances', 'cores', 'ram'} {{(pid=120471) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 13:33:40.985964 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_api:SELECT=100 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:33:40.990242 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-062c5c28-cb44-4588-aba6-43d7f2fc975d tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Going to run 1 instances... {{(pid=120471) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 13:33:40.993339 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-062c5c28-cb44-4588-aba6-43d7f2fc975d tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: 8a3b02c0-6943-45dc-9086-16ff29536118] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9beb860d-9c3f-4244-80aa-71a9c337a429',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120471) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 13:33:41.040926 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-9e02c59c-b01f-4cdd-8d3f-2e3c38f73a1b tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a8a480afb3438cb269ebd710c78018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26987661f54291b3cf7086b0a1c98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:41.055188 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-062c5c28-cb44-4588-aba6-43d7f2fc975d tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.901386 May 19 13:33:41.056486 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 193/357] 10.222.0.24 () {60 vars in 1146 bytes} [Thu May 19 13:33:40 2022] POST /compute/v2.1/servers => generated 409 bytes in 903 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 13:33:41.061603 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-b98ce47d-c487-4fce-b979-1cf24d645cc8 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:41.062625 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-b98ce47d-c487-4fce-b979-1cf24d645cc8 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] [instance: c97e472c-540e-4bd5-abaf-d7dadac8c6be] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:41.069481 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-b98ce47d-c487-4fce-b979-1cf24d645cc8 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:41.069926 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-b98ce47d-c487-4fce-b979-1cf24d645cc8 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:41.070706 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-b98ce47d-c487-4fce-b979-1cf24d645cc8 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:41.071106 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-b98ce47d-c487-4fce-b979-1cf24d645cc8 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:41.079898 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-9e02c59c-b01f-4cdd-8d3f-2e3c38f73a1b tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] 10.222.0.24 "GET /compute/v2.1/servers/07e97bb4-e6af-4707-a137-dd83d2887895" status: 200 len: 1314 microversion: 2.1 time: 0.326161 May 19 13:33:41.092776 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 165/358] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:40 2022] GET /compute/v2.1/servers/07e97bb4-e6af-4707-a137-dd83d2887895 => generated 1314 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:41.121929 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-1caba7a3-41ed-425a-929e-66af67ba878f tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:41.123314 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-1caba7a3-41ed-425a-929e-66af67ba878f tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: 8a3b02c0-6943-45dc-9086-16ff29536118] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:41.203163 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-1caba7a3-41ed-425a-929e-66af67ba878f tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:41.220849 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-1caba7a3-41ed-425a-929e-66af67ba878f tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118" status: 200 len: 1245 microversion: 2.1 time: 0.121075 May 19 13:33:41.223831 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 166/359] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:41 2022] GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118 => generated 1245 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:41.274360 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-b98ce47d-c487-4fce-b979-1cf24d645cc8 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11df35c0e4541deaea0494759301a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '510387333865470196f9be30ef62395c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:41.283003 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-b98ce47d-c487-4fce-b979-1cf24d645cc8 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] 10.222.0.24 "GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be" status: 200 len: 1548 microversion: 2.1 time: 0.225347 May 19 13:33:41.289773 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 194/360] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:41 2022] GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be => generated 1548 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:41.307816 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-8f9b60c1-0c4e-4eca-bc28-b6c11b2f9220 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:41.313265 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-fb1b7514-909f-4434-a647-2770135aef6a tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:41.319141 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-8f9b60c1-0c4e-4eca-bc28-b6c11b2f9220 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b11df35c0e4541deaea0494759301a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '510387333865470196f9be30ef62395c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:41.320056 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-fb1b7514-909f-4434-a647-2770135aef6a tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] [instance: 3dc7fd1b-e5d5-4f93-bcff-94b90ed75138] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:41.330697 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-8f9b60c1-0c4e-4eca-bc28-b6c11b2f9220 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Searching by: {'deleted': False, 'project_id': '510387333865470196f9be30ef62395c'} {{(pid=120472) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 13:33:41.345283 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-fb1b7514-909f-4434-a647-2770135aef6a tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:41.355723 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-fb1b7514-909f-4434-a647-2770135aef6a tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:41.371935 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-fb1b7514-909f-4434-a647-2770135aef6a tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:41.372962 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-fb1b7514-909f-4434-a647-2770135aef6a tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:41.374959 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-8f9b60c1-0c4e-4eca-bc28-b6c11b2f9220 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:41.375589 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-8f9b60c1-0c4e-4eca-bc28-b6c11b2f9220 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:41.376572 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-8f9b60c1-0c4e-4eca-bc28-b6c11b2f9220 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:41.377356 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-8f9b60c1-0c4e-4eca-bc28-b6c11b2f9220 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:41.598773 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.multi_cell_list [None req-8f9b60c1-0c4e-4eca-bc28-b6c11b2f9220 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120472) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 19 13:33:41.745334 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-8f9b60c1-0c4e-4eca-bc28-b6c11b2f9220 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] 10.222.0.24 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.441562 May 19 13:33:41.747202 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 167/361] 10.222.0.24 () {58 vars in 1124 bytes} [Thu May 19 13:33:41 2022] GET /compute/v2.1/servers => generated 342 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:33:41.757695 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-9acbd60e-53cd-473d-bcdb-990c374103e9 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:41.757695 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-9acbd60e-53cd-473d-bcdb-990c374103e9 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:41.767443 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-fb1b7514-909f-4434-a647-2770135aef6a tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26c50b54171491b987ca844091c6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96a605108ec47a081c60bc8dc16fd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:41.768312 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-9acbd60e-53cd-473d-bcdb-990c374103e9 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:41.768763 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-9acbd60e-53cd-473d-bcdb-990c374103e9 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:41.770076 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-9acbd60e-53cd-473d-bcdb-990c374103e9 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:41.774867 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-9acbd60e-53cd-473d-bcdb-990c374103e9 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:41.780898 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-fb1b7514-909f-4434-a647-2770135aef6a tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] 10.222.0.24 "GET /compute/v2.1/servers/3dc7fd1b-e5d5-4f93-bcff-94b90ed75138" status: 200 len: 1319 microversion: 2.1 time: 0.471504 May 19 13:33:41.798224 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 195/362] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:41 2022] GET /compute/v2.1/servers/3dc7fd1b-e5d5-4f93-bcff-94b90ed75138 => generated 1319 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:41.838409 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-45196e6e-fe12-4ac7-9bdd-3d24c6ec3ed1 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:41.839053 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-45196e6e-fe12-4ac7-9bdd-3d24c6ec3ed1 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] [instance: c97e472c-540e-4bd5-abaf-d7dadac8c6be] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:41.851530 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-45196e6e-fe12-4ac7-9bdd-3d24c6ec3ed1 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:41.852802 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-45196e6e-fe12-4ac7-9bdd-3d24c6ec3ed1 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:41.853805 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-45196e6e-fe12-4ac7-9bdd-3d24c6ec3ed1 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:41.855546 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-45196e6e-fe12-4ac7-9bdd-3d24c6ec3ed1 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:42.013483 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-9acbd60e-53cd-473d-bcdb-990c374103e9 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:42.026009 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-9acbd60e-53cd-473d-bcdb-990c374103e9 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:42.028020 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-9acbd60e-53cd-473d-bcdb-990c374103e9 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:42.033367 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-9acbd60e-53cd-473d-bcdb-990c374103e9 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1740 microversion: 2.20 time: 0.285262 May 19 13:33:42.034135 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 168/363] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:33:41 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1740 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:33:42.064698 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-45196e6e-fe12-4ac7-9bdd-3d24c6ec3ed1 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11df35c0e4541deaea0494759301a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '510387333865470196f9be30ef62395c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:42.074487 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-45196e6e-fe12-4ac7-9bdd-3d24c6ec3ed1 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] 10.222.0.24 "GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be" status: 200 len: 1548 microversion: 2.1 time: 0.275001 May 19 13:33:42.075362 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 196/364] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:41 2022] GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be => generated 1548 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:42.099241 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-6a8e6834-f8a9-44f8-b46d-30d9c3f0b4cc tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:42.100429 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-6a8e6834-f8a9-44f8-b46d-30d9c3f0b4cc tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] [instance: 07e97bb4-e6af-4707-a137-dd83d2887895] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:42.107286 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-6a8e6834-f8a9-44f8-b46d-30d9c3f0b4cc tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:42.107763 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-6a8e6834-f8a9-44f8-b46d-30d9c3f0b4cc tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:42.108778 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-6a8e6834-f8a9-44f8-b46d-30d9c3f0b4cc tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:42.109239 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-6a8e6834-f8a9-44f8-b46d-30d9c3f0b4cc tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:42.240121 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-bf091d34-0675-463a-a9bc-f61a5aba2f62 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:42.241123 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-bf091d34-0675-463a-a9bc-f61a5aba2f62 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: 8a3b02c0-6943-45dc-9086-16ff29536118] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:42.253211 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-bf091d34-0675-463a-a9bc-f61a5aba2f62 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:42.253993 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-bf091d34-0675-463a-a9bc-f61a5aba2f62 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:42.254970 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-bf091d34-0675-463a-a9bc-f61a5aba2f62 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:42.255647 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-bf091d34-0675-463a-a9bc-f61a5aba2f62 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:42.269155 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-6a8e6834-f8a9-44f8-b46d-30d9c3f0b4cc tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a8a480afb3438cb269ebd710c78018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26987661f54291b3cf7086b0a1c98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:42.271835 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_cell1:SELECT=100 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:33:42.279741 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-6a8e6834-f8a9-44f8-b46d-30d9c3f0b4cc tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] 10.222.0.24 "GET /compute/v2.1/servers/07e97bb4-e6af-4707-a137-dd83d2887895" status: 200 len: 1498 microversion: 2.1 time: 0.184612 May 19 13:33:42.281441 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 169/365] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:42 2022] GET /compute/v2.1/servers/07e97bb4-e6af-4707-a137-dd83d2887895 => generated 1498 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:42.384566 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-bf091d34-0675-463a-a9bc-f61a5aba2f62 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:42.399144 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-bf091d34-0675-463a-a9bc-f61a5aba2f62 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118" status: 200 len: 1241 microversion: 2.1 time: 0.162831 May 19 13:33:42.399733 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 197/366] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:42 2022] GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118 => generated 1241 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:33:42.816486 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-9962077c-bff7-453a-aeee-59362402346a tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:42.818292 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-9962077c-bff7-453a-aeee-59362402346a tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] [instance: 3dc7fd1b-e5d5-4f93-bcff-94b90ed75138] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:42.832765 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-9962077c-bff7-453a-aeee-59362402346a tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:42.833283 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-9962077c-bff7-453a-aeee-59362402346a tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:42.838737 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-9962077c-bff7-453a-aeee-59362402346a tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:42.839494 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-9962077c-bff7-453a-aeee-59362402346a tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:43.056129 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-f1fcfac6-8089-4886-91e4-43088137f6c4 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:43.057006 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-f1fcfac6-8089-4886-91e4-43088137f6c4 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:43.059652 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-9962077c-bff7-453a-aeee-59362402346a tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26c50b54171491b987ca844091c6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96a605108ec47a081c60bc8dc16fd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:43.069003 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-f1fcfac6-8089-4886-91e4-43088137f6c4 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:43.069719 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-f1fcfac6-8089-4886-91e4-43088137f6c4 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:43.072885 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-9962077c-bff7-453a-aeee-59362402346a tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] 10.222.0.24 "GET /compute/v2.1/servers/3dc7fd1b-e5d5-4f93-bcff-94b90ed75138" status: 200 len: 1319 microversion: 2.1 time: 0.260962 May 19 13:33:43.073949 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-f1fcfac6-8089-4886-91e4-43088137f6c4 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:43.074657 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-f1fcfac6-8089-4886-91e4-43088137f6c4 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:43.085959 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 170/367] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:42 2022] GET /compute/v2.1/servers/3dc7fd1b-e5d5-4f93-bcff-94b90ed75138 => generated 1319 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:43.118543 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [req-18d84ace-e491-4608-874d-9efb68c393df req-715d0946-64e8-4e3f-a16a-a14d4fff6400 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dc7fd1b-e5d5-4f93-bcff-94b90ed75138", "name": "network-vif-plugged", "status": "completed", "tag": "e53ff309-b270-4145-8e81-9fc7f9777b9d"}]} {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:33:43.139483 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [req-18d84ace-e491-4608-874d-9efb68c393df req-715d0946-64e8-4e3f-a16a-a14d4fff6400 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:43.140080 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [req-18d84ace-e491-4608-874d-9efb68c393df req-715d0946-64e8-4e3f-a16a-a14d4fff6400 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:43.181465 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.compute.server_external_events [req-18d84ace-e491-4608-874d-9efb68c393df req-715d0946-64e8-4e3f-a16a-a14d4fff6400 service nova] Creating event network-vif-plugged:e53ff309-b270-4145-8e81-9fc7f9777b9d for instance 3dc7fd1b-e5d5-4f93-bcff-94b90ed75138 on hv-cinder-84112 May 19 13:33:43.200016 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [req-18d84ace-e491-4608-874d-9efb68c393df req-715d0946-64e8-4e3f-a16a-a14d4fff6400 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087555 May 19 13:33:43.206093 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 171/368] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:33:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 13:33:43.303015 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-f1fcfac6-8089-4886-91e4-43088137f6c4 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:43.315208 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-f1fcfac6-8089-4886-91e4-43088137f6c4 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:43.317083 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-f1fcfac6-8089-4886-91e4-43088137f6c4 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:43.318377 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-f1fcfac6-8089-4886-91e4-43088137f6c4 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1740 microversion: 2.20 time: 0.268836 May 19 13:33:43.330055 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 198/369] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:33:43 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1740 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:33:43.417977 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-92fe0a28-45a5-4614-96a1-c7f99c464c26 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:43.418827 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-92fe0a28-45a5-4614-96a1-c7f99c464c26 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: 8a3b02c0-6943-45dc-9086-16ff29536118] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:43.427140 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-92fe0a28-45a5-4614-96a1-c7f99c464c26 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:43.427576 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-92fe0a28-45a5-4614-96a1-c7f99c464c26 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:43.429762 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-92fe0a28-45a5-4614-96a1-c7f99c464c26 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:43.430373 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-92fe0a28-45a5-4614-96a1-c7f99c464c26 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:43.453940 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-7b66aabb-c8d1-4d81-9fd8-547f16070f42 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:43.455247 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-7b66aabb-c8d1-4d81-9fd8-547f16070f42 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] [instance: 07e97bb4-e6af-4707-a137-dd83d2887895] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:43.462000 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-7b66aabb-c8d1-4d81-9fd8-547f16070f42 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:43.463256 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-7b66aabb-c8d1-4d81-9fd8-547f16070f42 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:43.464836 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-7b66aabb-c8d1-4d81-9fd8-547f16070f42 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:43.466274 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-7b66aabb-c8d1-4d81-9fd8-547f16070f42 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:43.498752 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-7b66aabb-c8d1-4d81-9fd8-547f16070f42 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] [instance: 07e97bb4-e6af-4707-a137-dd83d2887895] Going to try to terminate instance {{(pid=120471) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 13:33:43.625268 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-92fe0a28-45a5-4614-96a1-c7f99c464c26 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:43.643364 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-92fe0a28-45a5-4614-96a1-c7f99c464c26 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118" status: 200 len: 1303 microversion: 2.1 time: 0.229713 May 19 13:33:43.678344 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 172/370] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:43 2022] GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118 => generated 1303 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:43.708746 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-7b66aabb-c8d1-4d81-9fd8-547f16070f42 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] 10.222.0.24 "DELETE /compute/v2.1/servers/07e97bb4-e6af-4707-a137-dd83d2887895" status: 204 len: 0 microversion: 2.1 time: 0.259438 May 19 13:33:43.712607 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 199/371] 10.222.0.24 () {58 vars in 1238 bytes} [Thu May 19 13:33:43 2022] DELETE /compute/v2.1/servers/07e97bb4-e6af-4707-a137-dd83d2887895 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 19 13:33:43.720095 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-43cd9857-7900-4730-a638-6b577cc284bc tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:43.720795 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-43cd9857-7900-4730-a638-6b577cc284bc tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] [instance: 07e97bb4-e6af-4707-a137-dd83d2887895] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:43.734060 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-43cd9857-7900-4730-a638-6b577cc284bc tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:43.734796 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-43cd9857-7900-4730-a638-6b577cc284bc tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:43.736742 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-43cd9857-7900-4730-a638-6b577cc284bc tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:43.737182 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-43cd9857-7900-4730-a638-6b577cc284bc tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:43.937976 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-b87651a1-c1e2-497f-9f3d-c80198efef85 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cc92f313-e924-4b5c-b763-9782af3518ea"}} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:33:43.942242 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-b87651a1-c1e2-497f-9f3d-c80198efef85 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] [instance: c97e472c-540e-4bd5-abaf-d7dadac8c6be] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:43.956212 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-b87651a1-c1e2-497f-9f3d-c80198efef85 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:43.957838 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-b87651a1-c1e2-497f-9f3d-c80198efef85 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:43.958998 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-b87651a1-c1e2-497f-9f3d-c80198efef85 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:43.960604 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-b87651a1-c1e2-497f-9f3d-c80198efef85 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:43.989458 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-43cd9857-7900-4730-a638-6b577cc284bc tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a8a480afb3438cb269ebd710c78018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26987661f54291b3cf7086b0a1c98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:43.998321 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-43cd9857-7900-4730-a638-6b577cc284bc tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] 10.222.0.24 "GET /compute/v2.1/servers/07e97bb4-e6af-4707-a137-dd83d2887895" status: 200 len: 1504 microversion: 2.1 time: 0.283499 May 19 13:33:43.999207 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 173/372] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:43 2022] GET /compute/v2.1/servers/07e97bb4-e6af-4707-a137-dd83d2887895 => generated 1504 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:44.092152 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-1b793a93-5293-4fd0-b7b4-3bff914abd41 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:44.092779 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-1b793a93-5293-4fd0-b7b4-3bff914abd41 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] [instance: 3dc7fd1b-e5d5-4f93-bcff-94b90ed75138] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:44.099300 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-1b793a93-5293-4fd0-b7b4-3bff914abd41 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:44.100112 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-1b793a93-5293-4fd0-b7b4-3bff914abd41 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:44.101049 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-1b793a93-5293-4fd0-b7b4-3bff914abd41 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:44.101789 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-1b793a93-5293-4fd0-b7b4-3bff914abd41 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:44.300423 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-1b793a93-5293-4fd0-b7b4-3bff914abd41 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26c50b54171491b987ca844091c6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96a605108ec47a081c60bc8dc16fd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:44.309638 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-1b793a93-5293-4fd0-b7b4-3bff914abd41 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] 10.222.0.24 "GET /compute/v2.1/servers/3dc7fd1b-e5d5-4f93-bcff-94b90ed75138" status: 200 len: 1319 microversion: 2.1 time: 0.221356 May 19 13:33:44.310563 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 174/373] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:44 2022] GET /compute/v2.1/servers/3dc7fd1b-e5d5-4f93-bcff-94b90ed75138 => generated 1319 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:44.339600 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-32e0ef16-0d55-4d18-b443-286bd6c9534f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:44.344849 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-32e0ef16-0d55-4d18-b443-286bd6c9534f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:44.361527 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-32e0ef16-0d55-4d18-b443-286bd6c9534f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:44.363249 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-32e0ef16-0d55-4d18-b443-286bd6c9534f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:44.364306 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-32e0ef16-0d55-4d18-b443-286bd6c9534f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:44.365434 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-32e0ef16-0d55-4d18-b443-286bd6c9534f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:44.589073 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-32e0ef16-0d55-4d18-b443-286bd6c9534f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:44.599452 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-32e0ef16-0d55-4d18-b443-286bd6c9534f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:44.601104 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-32e0ef16-0d55-4d18-b443-286bd6c9534f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:44.602327 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-32e0ef16-0d55-4d18-b443-286bd6c9534f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1740 microversion: 2.20 time: 0.267520 May 19 13:33:44.617194 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 175/374] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:33:44 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1740 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:33:44.661010 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-bd6db02f-6099-447e-9603-d59e4a27adcd tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:44.661763 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-bd6db02f-6099-447e-9603-d59e4a27adcd tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: 8a3b02c0-6943-45dc-9086-16ff29536118] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:44.671389 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-bd6db02f-6099-447e-9603-d59e4a27adcd tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:44.671936 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-bd6db02f-6099-447e-9603-d59e4a27adcd tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:44.672793 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-bd6db02f-6099-447e-9603-d59e4a27adcd tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:44.673706 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-bd6db02f-6099-447e-9603-d59e4a27adcd tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:44.842370 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-bd6db02f-6099-447e-9603-d59e4a27adcd tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:44.850423 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-bd6db02f-6099-447e-9603-d59e4a27adcd tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118" status: 200 len: 1371 microversion: 2.1 time: 0.193837 May 19 13:33:44.851013 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 176/375] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:44 2022] GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118 => generated 1371 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:45.020818 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-fa99e618-2dfc-4f35-8b70-3a574f84996c tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:45.025439 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-fa99e618-2dfc-4f35-8b70-3a574f84996c tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] [instance: 07e97bb4-e6af-4707-a137-dd83d2887895] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:45.035937 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-fa99e618-2dfc-4f35-8b70-3a574f84996c tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:45.036724 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-fa99e618-2dfc-4f35-8b70-3a574f84996c tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:45.037729 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-fa99e618-2dfc-4f35-8b70-3a574f84996c tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:45.038343 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-fa99e618-2dfc-4f35-8b70-3a574f84996c tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:45.196402 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-fa99e618-2dfc-4f35-8b70-3a574f84996c tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a8a480afb3438cb269ebd710c78018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26987661f54291b3cf7086b0a1c98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:45.209605 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-fa99e618-2dfc-4f35-8b70-3a574f84996c tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] 10.222.0.24 "GET /compute/v2.1/servers/07e97bb4-e6af-4707-a137-dd83d2887895" status: 200 len: 1504 microversion: 2.1 time: 0.196102 May 19 13:33:45.210467 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 177/376] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:45 2022] GET /compute/v2.1/servers/07e97bb4-e6af-4707-a137-dd83d2887895 => generated 1504 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:45.327217 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-7a1a2f4c-67e5-451e-aae5-43004d50fc73 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:45.333668 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-7a1a2f4c-67e5-451e-aae5-43004d50fc73 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] [instance: 3dc7fd1b-e5d5-4f93-bcff-94b90ed75138] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:45.342924 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-7a1a2f4c-67e5-451e-aae5-43004d50fc73 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:45.343374 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-7a1a2f4c-67e5-451e-aae5-43004d50fc73 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:45.344150 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-7a1a2f4c-67e5-451e-aae5-43004d50fc73 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:45.344640 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-7a1a2f4c-67e5-451e-aae5-43004d50fc73 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:45.574186 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-7a1a2f4c-67e5-451e-aae5-43004d50fc73 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26c50b54171491b987ca844091c6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96a605108ec47a081c60bc8dc16fd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:45.584856 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-7a1a2f4c-67e5-451e-aae5-43004d50fc73 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] 10.222.0.24 "GET /compute/v2.1/servers/3dc7fd1b-e5d5-4f93-bcff-94b90ed75138" status: 200 len: 1319 microversion: 2.1 time: 0.261670 May 19 13:33:45.585825 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 178/377] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:45 2022] GET /compute/v2.1/servers/3dc7fd1b-e5d5-4f93-bcff-94b90ed75138 => generated 1319 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:33:45.631785 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-7323a65e-2035-4479-807e-909ae65ee825 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:45.632400 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-7323a65e-2035-4479-807e-909ae65ee825 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:45.644175 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-7323a65e-2035-4479-807e-909ae65ee825 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:45.644629 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-7323a65e-2035-4479-807e-909ae65ee825 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:45.645454 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-7323a65e-2035-4479-807e-909ae65ee825 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:45.645879 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-7323a65e-2035-4479-807e-909ae65ee825 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:45.857442 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-7323a65e-2035-4479-807e-909ae65ee825 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:45.868812 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-7323a65e-2035-4479-807e-909ae65ee825 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:45.870672 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-7323a65e-2035-4479-807e-909ae65ee825 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:45.873234 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-7323a65e-2035-4479-807e-909ae65ee825 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1740 microversion: 2.20 time: 0.250566 May 19 13:33:45.884046 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 179/378] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:33:45 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1740 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:33:45.884046 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-972af444-9a24-439e-861e-93f24f941ebc tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:45.884046 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-972af444-9a24-439e-861e-93f24f941ebc tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: 8a3b02c0-6943-45dc-9086-16ff29536118] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:45.886823 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-972af444-9a24-439e-861e-93f24f941ebc tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:45.887403 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-972af444-9a24-439e-861e-93f24f941ebc tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:45.889344 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-972af444-9a24-439e-861e-93f24f941ebc tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:45.889895 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-972af444-9a24-439e-861e-93f24f941ebc tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:46.225814 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-b87651a1-c1e2-497f-9f3d-c80198efef85 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] 10.222.0.24 "POST /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.298460 May 19 13:33:46.227435 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 200/379] 10.222.0.24 () {60 vars in 1322 bytes} [Thu May 19 13:33:43 2022] POST /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be/os-volume_attachments => generated 194 bytes in 2305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:33:46.269672 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-830b639b-dc57-4aca-a608-dc3947ac5dea tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:46.274147 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-830b639b-dc57-4aca-a608-dc3947ac5dea tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] [instance: 07e97bb4-e6af-4707-a137-dd83d2887895] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:46.290166 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-830b639b-dc57-4aca-a608-dc3947ac5dea tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:46.291705 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-830b639b-dc57-4aca-a608-dc3947ac5dea tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:46.293377 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-830b639b-dc57-4aca-a608-dc3947ac5dea tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:46.294196 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-830b639b-dc57-4aca-a608-dc3947ac5dea tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:46.552655 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-830b639b-dc57-4aca-a608-dc3947ac5dea tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a8a480afb3438cb269ebd710c78018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26987661f54291b3cf7086b0a1c98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:46.560768 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-830b639b-dc57-4aca-a608-dc3947ac5dea tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] 10.222.0.24 "GET /compute/v2.1/servers/07e97bb4-e6af-4707-a137-dd83d2887895" status: 200 len: 1504 microversion: 2.1 time: 0.331966 May 19 13:33:46.564926 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 201/380] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:46 2022] GET /compute/v2.1/servers/07e97bb4-e6af-4707-a137-dd83d2887895 => generated 1504 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:46.569815 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [req-3b019b41-1590-4260-9cca-fc27cad62be3 req-146324d7-0f0d-47b1-aa2b-174dce1f1979 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a3b02c0-6943-45dc-9086-16ff29536118", "tag": "3d603fe2-3873-40ee-9c1d-9815f7c92788"}]} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:33:46.585356 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-3b019b41-1590-4260-9cca-fc27cad62be3 req-146324d7-0f0d-47b1-aa2b-174dce1f1979 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:46.586127 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-3b019b41-1590-4260-9cca-fc27cad62be3 req-146324d7-0f0d-47b1-aa2b-174dce1f1979 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:46.600101 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.compute.server_external_events [req-3b019b41-1590-4260-9cca-fc27cad62be3 req-146324d7-0f0d-47b1-aa2b-174dce1f1979 service nova] Creating event network-changed:3d603fe2-3873-40ee-9c1d-9815f7c92788 for instance 8a3b02c0-6943-45dc-9086-16ff29536118 on hv-cinder-84112 May 19 13:33:46.612784 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-972af444-9a24-439e-861e-93f24f941ebc tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:46.616008 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [req-3b019b41-1590-4260-9cca-fc27cad62be3 req-146324d7-0f0d-47b1-aa2b-174dce1f1979 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049417 May 19 13:33:46.617884 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 202/381] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:33:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:33:46.620776 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-972af444-9a24-439e-861e-93f24f941ebc tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118" status: 200 len: 1371 microversion: 2.1 time: 0.745457 May 19 13:33:46.624849 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-01bcbaf2-004d-4e52-bef0-0414a5e57262 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:46.626468 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-01bcbaf2-004d-4e52-bef0-0414a5e57262 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] [instance: 3dc7fd1b-e5d5-4f93-bcff-94b90ed75138] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:46.633109 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-01bcbaf2-004d-4e52-bef0-0414a5e57262 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:46.633427 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 180/382] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:45 2022] GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118 => generated 1371 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:46.634024 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-01bcbaf2-004d-4e52-bef0-0414a5e57262 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:46.634991 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-01bcbaf2-004d-4e52-bef0-0414a5e57262 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:46.635596 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-01bcbaf2-004d-4e52-bef0-0414a5e57262 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:46.827077 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-01bcbaf2-004d-4e52-bef0-0414a5e57262 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26c50b54171491b987ca844091c6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96a605108ec47a081c60bc8dc16fd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:46.836559 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-01bcbaf2-004d-4e52-bef0-0414a5e57262 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] 10.222.0.24 "GET /compute/v2.1/servers/3dc7fd1b-e5d5-4f93-bcff-94b90ed75138" status: 200 len: 1319 microversion: 2.1 time: 0.217137 May 19 13:33:46.840992 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 203/383] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:46 2022] GET /compute/v2.1/servers/3dc7fd1b-e5d5-4f93-bcff-94b90ed75138 => generated 1319 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:46.892799 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-d9194f07-4cf0-4c60-8a6d-9b685cbeabdf tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:46.893749 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-d9194f07-4cf0-4c60-8a6d-9b685cbeabdf tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:46.904598 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-d9194f07-4cf0-4c60-8a6d-9b685cbeabdf tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:46.905048 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-d9194f07-4cf0-4c60-8a6d-9b685cbeabdf tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:46.916646 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-d9194f07-4cf0-4c60-8a6d-9b685cbeabdf tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:46.917094 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-d9194f07-4cf0-4c60-8a6d-9b685cbeabdf tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:47.146611 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [req-cbee1ff2-9fef-44fd-86b8-3aa2e9379117 req-a34026b7-50be-4c4d-83a9-b8ec904199dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07e97bb4-e6af-4707-a137-dd83d2887895", "name": "network-vif-deleted", "tag": "482e497d-dc94-47c6-8992-021c75b27d64"}]} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:33:47.169315 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-d9194f07-4cf0-4c60-8a6d-9b685cbeabdf tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:47.174874 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-cbee1ff2-9fef-44fd-86b8-3aa2e9379117 req-a34026b7-50be-4c4d-83a9-b8ec904199dd service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:47.175318 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-cbee1ff2-9fef-44fd-86b8-3aa2e9379117 req-a34026b7-50be-4c4d-83a9-b8ec904199dd service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:47.178399 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-d9194f07-4cf0-4c60-8a6d-9b685cbeabdf tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:47.180192 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-d9194f07-4cf0-4c60-8a6d-9b685cbeabdf tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:47.181557 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-d9194f07-4cf0-4c60-8a6d-9b685cbeabdf tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1740 microversion: 2.20 time: 0.293233 May 19 13:33:47.194460 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 181/384] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:33:46 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1740 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:33:47.216525 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.compute.server_external_events [req-cbee1ff2-9fef-44fd-86b8-3aa2e9379117 req-a34026b7-50be-4c4d-83a9-b8ec904199dd service nova] Creating event network-vif-deleted:482e497d-dc94-47c6-8992-021c75b27d64 for instance 07e97bb4-e6af-4707-a137-dd83d2887895 on hv-cinder-84112 May 19 13:33:47.236573 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [req-cbee1ff2-9fef-44fd-86b8-3aa2e9379117 req-a34026b7-50be-4c4d-83a9-b8ec904199dd service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100559 May 19 13:33:47.238641 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 204/385] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:33:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:33:47.580743 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-277cca41-07b2-484d-b4f4-ffd215f49fe7 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:47.581353 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-277cca41-07b2-484d-b4f4-ffd215f49fe7 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] [instance: 07e97bb4-e6af-4707-a137-dd83d2887895] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:47.587898 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-277cca41-07b2-484d-b4f4-ffd215f49fe7 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:47.588343 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-277cca41-07b2-484d-b4f4-ffd215f49fe7 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:47.589206 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-277cca41-07b2-484d-b4f4-ffd215f49fe7 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:47.589661 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-277cca41-07b2-484d-b4f4-ffd215f49fe7 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:47.624485 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-277cca41-07b2-484d-b4f4-ffd215f49fe7 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:47.625129 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-277cca41-07b2-484d-b4f4-ffd215f49fe7 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:47.625259 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.objects.instance [None req-277cca41-07b2-484d-b4f4-ffd215f49fe7 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lazy-loading 'fault' on Instance uuid 07e97bb4-e6af-4707-a137-dd83d2887895 {{(pid=120472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 13:33:47.644590 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-1f9df23f-f74e-4277-ae6a-eb2bb278ed52 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:47.645527 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-1f9df23f-f74e-4277-ae6a-eb2bb278ed52 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: 8a3b02c0-6943-45dc-9086-16ff29536118] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:47.656815 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-1f9df23f-f74e-4277-ae6a-eb2bb278ed52 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:47.657450 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-1f9df23f-f74e-4277-ae6a-eb2bb278ed52 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:47.658346 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-1f9df23f-f74e-4277-ae6a-eb2bb278ed52 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:47.659053 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-1f9df23f-f74e-4277-ae6a-eb2bb278ed52 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:47.677598 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-277cca41-07b2-484d-b4f4-ffd215f49fe7 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a8a480afb3438cb269ebd710c78018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a26987661f54291b3cf7086b0a1c98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:47.688971 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-277cca41-07b2-484d-b4f4-ffd215f49fe7 tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] 10.222.0.24 "GET /compute/v2.1/servers/07e97bb4-e6af-4707-a137-dd83d2887895" status: 200 len: 1304 microversion: 2.1 time: 0.111959 May 19 13:33:47.710032 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 182/386] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:47 2022] GET /compute/v2.1/servers/07e97bb4-e6af-4707-a137-dd83d2887895 => generated 1304 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:47.856903 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-ad5734d8-2ff5-4e19-9e2d-564ea800a823 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:47.858019 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-ad5734d8-2ff5-4e19-9e2d-564ea800a823 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] [instance: 3dc7fd1b-e5d5-4f93-bcff-94b90ed75138] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:47.864236 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-ad5734d8-2ff5-4e19-9e2d-564ea800a823 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:47.864685 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-ad5734d8-2ff5-4e19-9e2d-564ea800a823 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:47.865457 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-ad5734d8-2ff5-4e19-9e2d-564ea800a823 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:47.866047 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-ad5734d8-2ff5-4e19-9e2d-564ea800a823 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:47.920457 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-1f9df23f-f74e-4277-ae6a-eb2bb278ed52 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:47.932890 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-1f9df23f-f74e-4277-ae6a-eb2bb278ed52 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118" status: 200 len: 1371 microversion: 2.1 time: 0.296942 May 19 13:33:47.942337 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 205/387] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:47 2022] GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118 => generated 1371 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:33:48.072466 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-ad5734d8-2ff5-4e19-9e2d-564ea800a823 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26c50b54171491b987ca844091c6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96a605108ec47a081c60bc8dc16fd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:48.081819 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-ad5734d8-2ff5-4e19-9e2d-564ea800a823 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] 10.222.0.24 "GET /compute/v2.1/servers/3dc7fd1b-e5d5-4f93-bcff-94b90ed75138" status: 200 len: 1508 microversion: 2.1 time: 0.228837 May 19 13:33:48.085046 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 183/388] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:47 2022] GET /compute/v2.1/servers/3dc7fd1b-e5d5-4f93-bcff-94b90ed75138 => generated 1508 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:33:48.208034 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-acb45ccc-52a8-45af-b6d9-52f7209bb5a6 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:48.208729 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-acb45ccc-52a8-45af-b6d9-52f7209bb5a6 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:48.224651 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-acb45ccc-52a8-45af-b6d9-52f7209bb5a6 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:48.227169 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-acb45ccc-52a8-45af-b6d9-52f7209bb5a6 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:48.228576 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-acb45ccc-52a8-45af-b6d9-52f7209bb5a6 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:48.229984 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-acb45ccc-52a8-45af-b6d9-52f7209bb5a6 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:48.437776 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-acb45ccc-52a8-45af-b6d9-52f7209bb5a6 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:48.456613 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-acb45ccc-52a8-45af-b6d9-52f7209bb5a6 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:48.458165 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-acb45ccc-52a8-45af-b6d9-52f7209bb5a6 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:48.467554 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-acb45ccc-52a8-45af-b6d9-52f7209bb5a6 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1740 microversion: 2.20 time: 0.256963 May 19 13:33:48.468187 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 206/389] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:33:48 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1740 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:33:48.707640 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-0aa879c1-79e3-4ed1-9486-7705374cb29f tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:48.708935 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-0aa879c1-79e3-4ed1-9486-7705374cb29f tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] [instance: 07e97bb4-e6af-4707-a137-dd83d2887895] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:48.715933 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-0aa879c1-79e3-4ed1-9486-7705374cb29f tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:48.716370 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-0aa879c1-79e3-4ed1-9486-7705374cb29f tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:48.722219 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-0aa879c1-79e3-4ed1-9486-7705374cb29f tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:48.722688 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-0aa879c1-79e3-4ed1-9486-7705374cb29f tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:48.751373 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.wsgi [None req-0aa879c1-79e3-4ed1-9486-7705374cb29f tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] HTTP exception thrown: Instance 07e97bb4-e6af-4707-a137-dd83d2887895 could not be found. May 19 13:33:48.753072 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-0aa879c1-79e3-4ed1-9486-7705374cb29f tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Request method failure captured: May 19 13:33:48.753072 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: request: GET /compute/v2.1/servers/07e97bb4-e6af-4707-a137-dd83d2887895 HTTP/1.1 May 19 13:33:48.753072 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Accept: application/json May 19 13:33:48.753072 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Accept-Encoding: identity May 19 13:33:48.753072 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Connection: close May 19 13:33:48.753072 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Content-Length: 0 May 19 13:33:48.753072 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Content-Type: application/json May 19 13:33:48.753072 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Host: 10.222.0.24 May 19 13:33:48.753072 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Openstack-System-Scope: None May 19 13:33:48.753072 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: User-Agent: python-urllib3/1.26.9 May 19 13:33:48.753072 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Auth-Token: gAAAAABihkb29HEtm4Ykrx4gIr1Gitue5MpyPR-7XiOh2GS2HUQqkNpho0MwZA134nMMtsL8ZG3yxk8SB5UYMbgQAN9vW9O9Uqh_pc9HTo-ebUxjvJP9tpfXQvPZUBkTkOdFp84o06RHkv085MNr19LegdibNtUGUhND3PW1VPiae4Ew-rihRtA May 19 13:33:48.753072 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Domain-Id: None May 19 13:33:48.753072 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Domain-Name: None May 19 13:33:48.753072 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Identity-Status: Confirmed May 19 13:33:48.753072 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Is-Admin-Project: True May 19 13:33:48.753072 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Domain-Id: default May 19 13:33:48.753072 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Domain-Name: Default May 19 13:33:48.753072 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Id: 5a26987661f54291b3cf7086b0a1c98c May 19 13:33:48.753072 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Name: tempest-VolumesActionsTest-939624476 May 19 13:33:48.753072 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Role: reader,member May 19 13:33:48.753072 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Roles: reader,member May 19 13:33:48.756000 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/5a26987661f54291b3cf7086b0a1c98c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/5a26987661f54291b3cf7086b0a1c98c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_5a26987661f54291b3cf7086b0a1c98c", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/5a26987661f54291b3cf7086b0a1c98c"}]}] May 19 13:33:48.756000 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant: tempest-VolumesActionsTest-939624476 May 19 13:33:48.756000 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant-Id: 5a26987661f54291b3cf7086b0a1c98c May 19 13:33:48.756000 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant-Name: tempest-VolumesActionsTest-939624476 May 19 13:33:48.756000 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User: tempest-VolumesActionsTest-939624476-project May 19 13:33:48.756000 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Domain-Id: default May 19 13:33:48.756000 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Domain-Name: Default May 19 13:33:48.756000 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Id: d9a8a480afb3438cb269ebd710c78018 May 19 13:33:48.756000 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Name: tempest-VolumesActionsTest-939624476-project May 19 13:33:48.756000 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: method: > May 19 13:33:48.756000 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: exception: Instance 07e97bb4-e6af-4707-a137-dd83d2887895 could not be found. May 19 13:33:48.756000 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: action_args: {'id': '07e97bb4-e6af-4707-a137-dd83d2887895'} May 19 13:33:48.757678 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:33:48.757678 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:33:48.757678 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 13:33:48.757678 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 13:33:48.757678 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 13:33:48.757678 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 13:33:48.757678 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 13:33:48.757678 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 13:33:48.757678 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 13:33:48.757678 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 13:33:48.757678 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07e97bb4-e6af-4707-a137-dd83d2887895 could not be found. May 19 13:33:48.757678 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:33:48.757678 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:33:48.757678 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:33:48.757678 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:33:48.757678 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:33:48.757678 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:33:48.757678 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:33:48.757678 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:33:48.757678 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:33:48.760472 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:33:48.760472 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 13:33:48.760472 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 13:33:48.760472 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 13:33:48.760472 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 13:33:48.760472 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 13:33:48.760472 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 13:33:48.760472 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07e97bb4-e6af-4707-a137-dd83d2887895 could not be found. May 19 13:33:48.760472 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:33:48.760472 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:33:48.760472 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:33:48.760472 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:33:48.760472 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:33:48.760472 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:33:48.760472 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:33:48.760472 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:33:48.760472 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07e97bb4-e6af-4707-a137-dd83d2887895 could not be found. May 19 13:33:48.760472 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:33:48.766239 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-0aa879c1-79e3-4ed1-9486-7705374cb29f tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] Returning 404 to user: Instance 07e97bb4-e6af-4707-a137-dd83d2887895 could not be found. {{(pid=120472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:33:48.766239 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-0aa879c1-79e3-4ed1-9486-7705374cb29f tempest-VolumesActionsTest-939624476 tempest-VolumesActionsTest-939624476-project] 10.222.0.24 "GET /compute/v2.1/servers/07e97bb4-e6af-4707-a137-dd83d2887895" status: 404 len: 111 microversion: 2.1 time: 0.051300 May 19 13:33:48.766239 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 184/390] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:48 2022] GET /compute/v2.1/servers/07e97bb4-e6af-4707-a137-dd83d2887895 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 13:33:48.951845 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-c49675ec-33e2-408e-a917-058634348a0f tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:48.952448 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-c49675ec-33e2-408e-a917-058634348a0f tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: 8a3b02c0-6943-45dc-9086-16ff29536118] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:48.960505 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-c49675ec-33e2-408e-a917-058634348a0f tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:48.961910 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-c49675ec-33e2-408e-a917-058634348a0f tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:48.963096 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-c49675ec-33e2-408e-a917-058634348a0f tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:48.963780 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-c49675ec-33e2-408e-a917-058634348a0f tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:49.121245 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-c49675ec-33e2-408e-a917-058634348a0f tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:49.125627 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:33:49.133339 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-c49675ec-33e2-408e-a917-058634348a0f tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118" status: 200 len: 1371 microversion: 2.1 time: 0.185924 May 19 13:33:49.134198 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 207/391] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:48 2022] GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118 => generated 1371 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:49.487324 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-3277cce4-8bc6-4fc0-9159-bd928ec9f8ea tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:49.488047 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-3277cce4-8bc6-4fc0-9159-bd928ec9f8ea tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:49.504490 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-3277cce4-8bc6-4fc0-9159-bd928ec9f8ea tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:49.517177 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-3277cce4-8bc6-4fc0-9159-bd928ec9f8ea tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:49.518363 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-3277cce4-8bc6-4fc0-9159-bd928ec9f8ea tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:49.518798 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-3277cce4-8bc6-4fc0-9159-bd928ec9f8ea tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:49.729278 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-3277cce4-8bc6-4fc0-9159-bd928ec9f8ea tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:49.766839 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-3277cce4-8bc6-4fc0-9159-bd928ec9f8ea tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:49.768955 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-3277cce4-8bc6-4fc0-9159-bd928ec9f8ea tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:49.771566 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-3277cce4-8bc6-4fc0-9159-bd928ec9f8ea tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1740 microversion: 2.20 time: 0.288267 May 19 13:33:49.775681 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 185/392] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:33:49 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1740 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:33:50.153271 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-3998ed61-bbff-4039-9a15-5674da8bc2df tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:50.154254 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-3998ed61-bbff-4039-9a15-5674da8bc2df tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: 8a3b02c0-6943-45dc-9086-16ff29536118] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:50.162654 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-3998ed61-bbff-4039-9a15-5674da8bc2df tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:50.163184 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-3998ed61-bbff-4039-9a15-5674da8bc2df tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:50.164202 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-3998ed61-bbff-4039-9a15-5674da8bc2df tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:50.164722 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-3998ed61-bbff-4039-9a15-5674da8bc2df tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:50.336319 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-3998ed61-bbff-4039-9a15-5674da8bc2df tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:50.344402 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-3998ed61-bbff-4039-9a15-5674da8bc2df tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118" status: 200 len: 1371 microversion: 2.1 time: 0.196133 May 19 13:33:50.345258 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 208/393] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:50 2022] GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118 => generated 1371 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:50.809218 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-a08ff023-a77a-41a8-b16b-9e10d6c4199b tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:50.809818 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-a08ff023-a77a-41a8-b16b-9e10d6c4199b tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:50.816794 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-a08ff023-a77a-41a8-b16b-9e10d6c4199b tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:50.817240 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-a08ff023-a77a-41a8-b16b-9e10d6c4199b tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:50.818034 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-a08ff023-a77a-41a8-b16b-9e10d6c4199b tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:50.818462 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-a08ff023-a77a-41a8-b16b-9e10d6c4199b tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:50.967200 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-a08ff023-a77a-41a8-b16b-9e10d6c4199b tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:50.975244 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-a08ff023-a77a-41a8-b16b-9e10d6c4199b tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:50.976806 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-a08ff023-a77a-41a8-b16b-9e10d6c4199b tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:50.978018 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-a08ff023-a77a-41a8-b16b-9e10d6c4199b tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1740 microversion: 2.20 time: 0.173049 May 19 13:33:50.978571 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 186/394] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:33:50 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1740 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:33:51.361440 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-560480dd-ced1-4214-b31b-5a357c5d61fd tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:51.362068 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-560480dd-ced1-4214-b31b-5a357c5d61fd tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: 8a3b02c0-6943-45dc-9086-16ff29536118] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:51.363959 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_cell0:SELECT=2 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:33:51.364613 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_cell0:SELECT=6 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:33:51.372373 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-560480dd-ced1-4214-b31b-5a357c5d61fd tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:51.372838 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-560480dd-ced1-4214-b31b-5a357c5d61fd tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:51.373644 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-560480dd-ced1-4214-b31b-5a357c5d61fd tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:51.374075 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-560480dd-ced1-4214-b31b-5a357c5d61fd tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:51.561395 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-560480dd-ced1-4214-b31b-5a357c5d61fd tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:51.570253 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-560480dd-ced1-4214-b31b-5a357c5d61fd tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118" status: 200 len: 1371 microversion: 2.1 time: 0.212711 May 19 13:33:51.570861 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 209/395] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:51 2022] GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118 => generated 1371 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:51.996270 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-e3505d1c-a5eb-4548-896e-c0bcba2b3107 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:51.996998 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-e3505d1c-a5eb-4548-896e-c0bcba2b3107 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:52.001838 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_cell0:SELECT=6 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:33:52.002497 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_cell0:SELECT=2 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:33:52.009354 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-e3505d1c-a5eb-4548-896e-c0bcba2b3107 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:52.009835 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-e3505d1c-a5eb-4548-896e-c0bcba2b3107 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:52.010605 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-e3505d1c-a5eb-4548-896e-c0bcba2b3107 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:52.011038 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-e3505d1c-a5eb-4548-896e-c0bcba2b3107 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:52.026435 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_cell1:SELECT=100 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:33:52.148031 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-e3505d1c-a5eb-4548-896e-c0bcba2b3107 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:52.156313 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-e3505d1c-a5eb-4548-896e-c0bcba2b3107 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:52.158228 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-e3505d1c-a5eb-4548-896e-c0bcba2b3107 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:52.159560 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-e3505d1c-a5eb-4548-896e-c0bcba2b3107 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1722 microversion: 2.20 time: 0.167279 May 19 13:33:52.160183 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 187/396] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:33:51 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:33:52.587226 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-f9762a71-2e1d-40ea-940d-276264c52ce2 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:52.587831 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-f9762a71-2e1d-40ea-940d-276264c52ce2 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: 8a3b02c0-6943-45dc-9086-16ff29536118] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:52.595756 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-f9762a71-2e1d-40ea-940d-276264c52ce2 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:52.596205 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-f9762a71-2e1d-40ea-940d-276264c52ce2 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:52.596962 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-f9762a71-2e1d-40ea-940d-276264c52ce2 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:52.597392 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-f9762a71-2e1d-40ea-940d-276264c52ce2 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:52.739657 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-f9762a71-2e1d-40ea-940d-276264c52ce2 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:52.747449 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-f9762a71-2e1d-40ea-940d-276264c52ce2 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118" status: 200 len: 1371 microversion: 2.1 time: 0.164105 May 19 13:33:52.747997 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 210/397] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:52 2022] GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118 => generated 1371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:53.181875 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-833c2335-0488-408b-99c8-82f0aeacdb74 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:53.182585 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-833c2335-0488-408b-99c8-82f0aeacdb74 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:53.192481 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-833c2335-0488-408b-99c8-82f0aeacdb74 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:53.193105 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-833c2335-0488-408b-99c8-82f0aeacdb74 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:53.194270 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-833c2335-0488-408b-99c8-82f0aeacdb74 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:53.194857 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-833c2335-0488-408b-99c8-82f0aeacdb74 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:53.331172 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-833c2335-0488-408b-99c8-82f0aeacdb74 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:53.344453 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-833c2335-0488-408b-99c8-82f0aeacdb74 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:53.346928 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-833c2335-0488-408b-99c8-82f0aeacdb74 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:53.348726 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-833c2335-0488-408b-99c8-82f0aeacdb74 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1722 microversion: 2.20 time: 0.172328 May 19 13:33:53.349457 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 188/398] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:33:53 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:33:53.765469 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-08a06a5e-cc6b-47c5-8d41-dabdc48f7b72 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:53.766171 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-08a06a5e-cc6b-47c5-8d41-dabdc48f7b72 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: 8a3b02c0-6943-45dc-9086-16ff29536118] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:53.773850 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-08a06a5e-cc6b-47c5-8d41-dabdc48f7b72 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:53.774345 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-08a06a5e-cc6b-47c5-8d41-dabdc48f7b72 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:53.775193 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-08a06a5e-cc6b-47c5-8d41-dabdc48f7b72 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:53.775671 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-08a06a5e-cc6b-47c5-8d41-dabdc48f7b72 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:53.926165 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-08a06a5e-cc6b-47c5-8d41-dabdc48f7b72 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:53.927295 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-08a06a5e-cc6b-47c5-8d41-dabdc48f7b72 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118" status: 200 len: 1371 microversion: 2.1 time: 0.166026 May 19 13:33:53.927861 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 211/399] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:53 2022] GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118 => generated 1371 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:54.370355 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-0ddc7b8b-cf8c-4794-aaaf-e53f54cc6cff tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:54.371801 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-0ddc7b8b-cf8c-4794-aaaf-e53f54cc6cff tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:54.378700 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-0ddc7b8b-cf8c-4794-aaaf-e53f54cc6cff tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:54.379147 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-0ddc7b8b-cf8c-4794-aaaf-e53f54cc6cff tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:54.379912 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-0ddc7b8b-cf8c-4794-aaaf-e53f54cc6cff tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:54.380349 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-0ddc7b8b-cf8c-4794-aaaf-e53f54cc6cff tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:54.519634 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-0ddc7b8b-cf8c-4794-aaaf-e53f54cc6cff tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:54.527657 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-0ddc7b8b-cf8c-4794-aaaf-e53f54cc6cff tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:54.529150 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-0ddc7b8b-cf8c-4794-aaaf-e53f54cc6cff tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:54.530388 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-0ddc7b8b-cf8c-4794-aaaf-e53f54cc6cff tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1722 microversion: 2.20 time: 0.164018 May 19 13:33:54.530944 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 189/400] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:33:54 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:33:54.945433 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-80912ad8-45c3-4e1b-a248-822c90983a45 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:54.946415 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-80912ad8-45c3-4e1b-a248-822c90983a45 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: 8a3b02c0-6943-45dc-9086-16ff29536118] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:54.954344 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-80912ad8-45c3-4e1b-a248-822c90983a45 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:54.954780 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-80912ad8-45c3-4e1b-a248-822c90983a45 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:54.955544 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-80912ad8-45c3-4e1b-a248-822c90983a45 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:54.956148 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-80912ad8-45c3-4e1b-a248-822c90983a45 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:55.205117 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-80912ad8-45c3-4e1b-a248-822c90983a45 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:55.212731 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-80912ad8-45c3-4e1b-a248-822c90983a45 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118" status: 200 len: 1371 microversion: 2.1 time: 0.272688 May 19 13:33:55.213328 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 212/401] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:54 2022] GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118 => generated 1371 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:55.554675 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-83caa740-3f48-479b-ba16-5e2dd98c3365 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:55.555284 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-83caa740-3f48-479b-ba16-5e2dd98c3365 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:55.563107 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-83caa740-3f48-479b-ba16-5e2dd98c3365 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:55.563618 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-83caa740-3f48-479b-ba16-5e2dd98c3365 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:55.564739 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-83caa740-3f48-479b-ba16-5e2dd98c3365 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:55.565312 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-83caa740-3f48-479b-ba16-5e2dd98c3365 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:55.715536 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-83caa740-3f48-479b-ba16-5e2dd98c3365 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:55.727076 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-83caa740-3f48-479b-ba16-5e2dd98c3365 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:55.729252 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-83caa740-3f48-479b-ba16-5e2dd98c3365 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:55.730513 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-83caa740-3f48-479b-ba16-5e2dd98c3365 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1722 microversion: 2.20 time: 0.180057 May 19 13:33:55.731721 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 190/402] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:33:55 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:33:56.017630 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [req-1fa5843b-872f-4599-9d7f-684724834044 req-6ca22c23-b5a1-4cd3-8c3d-6f61a320e2c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a3b02c0-6943-45dc-9086-16ff29536118", "name": "network-vif-plugged", "status": "completed", "tag": "3d603fe2-3873-40ee-9c1d-9815f7c92788"}]} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:33:56.027479 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-1fa5843b-872f-4599-9d7f-684724834044 req-6ca22c23-b5a1-4cd3-8c3d-6f61a320e2c3 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:56.028364 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-1fa5843b-872f-4599-9d7f-684724834044 req-6ca22c23-b5a1-4cd3-8c3d-6f61a320e2c3 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:56.043400 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.compute.server_external_events [req-1fa5843b-872f-4599-9d7f-684724834044 req-6ca22c23-b5a1-4cd3-8c3d-6f61a320e2c3 service nova] Creating event network-vif-plugged:3d603fe2-3873-40ee-9c1d-9815f7c92788 for instance 8a3b02c0-6943-45dc-9086-16ff29536118 on hv-cinder-84112 May 19 13:33:56.049260 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [req-1fa5843b-872f-4599-9d7f-684724834044 req-6ca22c23-b5a1-4cd3-8c3d-6f61a320e2c3 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035639 May 19 13:33:56.049887 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 213/403] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:33:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:33:56.187443 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-915e0600-7156-4b65-a4b9-5a76a097b2bf tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:56.188120 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-915e0600-7156-4b65-a4b9-5a76a097b2bf tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] [instance: c97e472c-540e-4bd5-abaf-d7dadac8c6be] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:56.211165 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-915e0600-7156-4b65-a4b9-5a76a097b2bf tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:56.211621 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-915e0600-7156-4b65-a4b9-5a76a097b2bf tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:56.212412 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-915e0600-7156-4b65-a4b9-5a76a097b2bf tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:56.212845 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-915e0600-7156-4b65-a4b9-5a76a097b2bf tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:56.235129 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-c70449d6-5da9-4ea8-b8f9-cf069ee630cd tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:56.235958 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-c70449d6-5da9-4ea8-b8f9-cf069ee630cd tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: 8a3b02c0-6943-45dc-9086-16ff29536118] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:56.242865 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-c70449d6-5da9-4ea8-b8f9-cf069ee630cd tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:56.243658 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-c70449d6-5da9-4ea8-b8f9-cf069ee630cd tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:56.244962 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-c70449d6-5da9-4ea8-b8f9-cf069ee630cd tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:56.245626 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-c70449d6-5da9-4ea8-b8f9-cf069ee630cd tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:56.365711 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-915e0600-7156-4b65-a4b9-5a76a097b2bf tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11df35c0e4541deaea0494759301a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '510387333865470196f9be30ef62395c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:56.373910 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-915e0600-7156-4b65-a4b9-5a76a097b2bf tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] 10.222.0.24 "GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be" status: 200 len: 1594 microversion: 2.1 time: 0.191207 May 19 13:33:56.375308 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 191/404] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:56 2022] GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be => generated 1594 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:56.427682 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-c70449d6-5da9-4ea8-b8f9-cf069ee630cd tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:56.438832 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-c70449d6-5da9-4ea8-b8f9-cf069ee630cd tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118" status: 200 len: 1371 microversion: 2.1 time: 0.209223 May 19 13:33:56.439902 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 214/405] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:56 2022] GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118 => generated 1371 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:56.753645 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-f711772a-449f-4815-98ff-df6d671e919f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:56.755178 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-f711772a-449f-4815-98ff-df6d671e919f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:56.764837 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-f711772a-449f-4815-98ff-df6d671e919f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:56.765894 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-f711772a-449f-4815-98ff-df6d671e919f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:56.767002 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-f711772a-449f-4815-98ff-df6d671e919f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:56.767664 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-f711772a-449f-4815-98ff-df6d671e919f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:56.940842 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-f711772a-449f-4815-98ff-df6d671e919f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:56.951407 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-f711772a-449f-4815-98ff-df6d671e919f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:56.955305 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-f711772a-449f-4815-98ff-df6d671e919f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:56.958882 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-f711772a-449f-4815-98ff-df6d671e919f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1722 microversion: 2.20 time: 0.212782 May 19 13:33:56.959822 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 192/406] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:33:56 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1722 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:33:57.458104 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-b4d394a8-f70f-4fb6-8935-b530e5e70dff tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:57.458806 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-b4d394a8-f70f-4fb6-8935-b530e5e70dff tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: 8a3b02c0-6943-45dc-9086-16ff29536118] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:57.467656 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-b4d394a8-f70f-4fb6-8935-b530e5e70dff tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:57.468239 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-b4d394a8-f70f-4fb6-8935-b530e5e70dff tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:57.469802 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-b4d394a8-f70f-4fb6-8935-b530e5e70dff tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:57.470299 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-b4d394a8-f70f-4fb6-8935-b530e5e70dff tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:57.888181 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-b4d394a8-f70f-4fb6-8935-b530e5e70dff tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:57.899053 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-b4d394a8-f70f-4fb6-8935-b530e5e70dff tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118" status: 200 len: 1371 microversion: 2.1 time: 0.446229 May 19 13:33:57.918948 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 215/407] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:57 2022] GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118 => generated 1371 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:57.987818 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-8b04a700-12b8-4845-b79e-00d95ef08d07 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:57.988703 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-8b04a700-12b8-4845-b79e-00d95ef08d07 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:58.008230 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-8b04a700-12b8-4845-b79e-00d95ef08d07 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:58.009143 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-8b04a700-12b8-4845-b79e-00d95ef08d07 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:58.010641 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-8b04a700-12b8-4845-b79e-00d95ef08d07 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:58.011296 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-8b04a700-12b8-4845-b79e-00d95ef08d07 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:58.074366 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [req-7e1822ca-a15f-421c-80e2-709933ddec95 req-0d6e5636-b100-4ccd-b212-c79be06d9b7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "323322ec-2e2e-424b-a411-8a34069bcf10", "name": "network-vif-unplugged", "status": "completed", "tag": "1ae6b782-184e-4357-ab26-9a0648e0a6a3"}]} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:33:58.087141 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-7e1822ca-a15f-421c-80e2-709933ddec95 req-0d6e5636-b100-4ccd-b212-c79be06d9b7a service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:58.087591 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-7e1822ca-a15f-421c-80e2-709933ddec95 req-0d6e5636-b100-4ccd-b212-c79be06d9b7a service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:58.114677 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.compute.server_external_events [req-7e1822ca-a15f-421c-80e2-709933ddec95 req-0d6e5636-b100-4ccd-b212-c79be06d9b7a service nova] Creating event network-vif-unplugged:1ae6b782-184e-4357-ab26-9a0648e0a6a3 for instance 323322ec-2e2e-424b-a411-8a34069bcf10 on hv-cinder-84112 May 19 13:33:58.145069 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [req-7e1822ca-a15f-421c-80e2-709933ddec95 req-0d6e5636-b100-4ccd-b212-c79be06d9b7a service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074144 May 19 13:33:58.147250 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 216/408] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:33:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 13:33:58.218716 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-8b04a700-12b8-4845-b79e-00d95ef08d07 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:58.229878 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-8b04a700-12b8-4845-b79e-00d95ef08d07 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:58.245522 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-8b04a700-12b8-4845-b79e-00d95ef08d07 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:58.254683 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-8b04a700-12b8-4845-b79e-00d95ef08d07 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1725 microversion: 2.20 time: 0.275705 May 19 13:33:58.268365 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 193/409] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:33:57 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1725 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:33:58.277168 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-5e844b1f-c422-442e-9d08-fa6747abab4b tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3e99d11c-8447-4649-a343-7b291790bd83"}} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:33:58.278668 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-5e844b1f-c422-442e-9d08-fa6747abab4b tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:58.286630 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-5e844b1f-c422-442e-9d08-fa6747abab4b tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:58.287246 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-5e844b1f-c422-442e-9d08-fa6747abab4b tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:58.288301 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-5e844b1f-c422-442e-9d08-fa6747abab4b tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:58.289294 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-5e844b1f-c422-442e-9d08-fa6747abab4b tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:58.855115 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-5e844b1f-c422-442e-9d08-fa6747abab4b tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "POST /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.584512 May 19 13:33:58.856782 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 217/410] 10.222.0.24 () {62 vars in 1363 bytes} [Thu May 19 13:33:58 2022] POST /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10/os-volume_attachments => generated 188 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 13:33:58.918075 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-6d3372f8-cd5c-4855-8782-d4ce7f7b6f61 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:58.919178 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-6d3372f8-cd5c-4855-8782-d4ce7f7b6f61 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: 8a3b02c0-6943-45dc-9086-16ff29536118] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:58.933292 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-6d3372f8-cd5c-4855-8782-d4ce7f7b6f61 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:58.934323 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-6d3372f8-cd5c-4855-8782-d4ce7f7b6f61 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:58.936001 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-6d3372f8-cd5c-4855-8782-d4ce7f7b6f61 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:58.936937 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-6d3372f8-cd5c-4855-8782-d4ce7f7b6f61 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:59.137753 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-878afeb4-a167-4eb9-a81f-0ae63779eaa0 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:33:59.138342 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-878afeb4-a167-4eb9-a81f-0ae63779eaa0 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:59.159763 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-878afeb4-a167-4eb9-a81f-0ae63779eaa0 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:59.160212 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-878afeb4-a167-4eb9-a81f-0ae63779eaa0 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:59.160987 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-878afeb4-a167-4eb9-a81f-0ae63779eaa0 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:59.161451 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-878afeb4-a167-4eb9-a81f-0ae63779eaa0 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:59.197090 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-6d3372f8-cd5c-4855-8782-d4ce7f7b6f61 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:59.210343 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-6d3372f8-cd5c-4855-8782-d4ce7f7b6f61 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118" status: 200 len: 1371 microversion: 2.1 time: 0.297763 May 19 13:33:59.211565 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 194/411] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:33:58 2022] GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118 => generated 1371 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:33:59.383947 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-878afeb4-a167-4eb9-a81f-0ae63779eaa0 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "POST /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10/action" status: 202 len: 0 microversion: 2.20 time: 0.249132 May 19 13:33:59.385212 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 218/412] 10.222.0.24 () {62 vars in 1318 bytes} [Thu May 19 13:33:59 2022] POST /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10/action => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 19 13:33:59.404320 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-d499415c-aa13-4f51-8baa-dd906e510b8e tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:33:59.406114 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-d499415c-aa13-4f51-8baa-dd906e510b8e tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:33:59.421144 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-d499415c-aa13-4f51-8baa-dd906e510b8e tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:59.423637 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-d499415c-aa13-4f51-8baa-dd906e510b8e tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:59.425994 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-d499415c-aa13-4f51-8baa-dd906e510b8e tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:59.426656 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-d499415c-aa13-4f51-8baa-dd906e510b8e tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:59.561756 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [req-9c3c3974-a947-44e3-906d-8db6cd4ad35f req-720f0a43-0b99-4504-8aba-2f168b964456 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c97e472c-540e-4bd5-abaf-d7dadac8c6be", "tag": "97ed1b45-3101-4569-a101-5346f9044405"}]} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:33:59.589149 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-9c3c3974-a947-44e3-906d-8db6cd4ad35f req-720f0a43-0b99-4504-8aba-2f168b964456 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:33:59.589640 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-9c3c3974-a947-44e3-906d-8db6cd4ad35f req-720f0a43-0b99-4504-8aba-2f168b964456 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:33:59.645178 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.compute.server_external_events [req-9c3c3974-a947-44e3-906d-8db6cd4ad35f req-720f0a43-0b99-4504-8aba-2f168b964456 service nova] Creating event network-changed:97ed1b45-3101-4569-a101-5346f9044405 for instance c97e472c-540e-4bd5-abaf-d7dadac8c6be on hv-cinder-84112 May 19 13:33:59.665151 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [req-9c3c3974-a947-44e3-906d-8db6cd4ad35f req-720f0a43-0b99-4504-8aba-2f168b964456 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105835 May 19 13:33:59.666025 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 219/413] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:33:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 13:33:59.814424 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-d499415c-aa13-4f51-8baa-dd906e510b8e tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:59.825281 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-d499415c-aa13-4f51-8baa-dd906e510b8e tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:59.832844 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-d499415c-aa13-4f51-8baa-dd906e510b8e tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:33:59.834722 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-d499415c-aa13-4f51-8baa-dd906e510b8e tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1751 microversion: 2.20 time: 0.441783 May 19 13:33:59.835821 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 195/414] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:33:59 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1751 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:34:00.236597 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-56ab7391-b7dd-4022-a247-d8a7fa8c2241 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:34:00.242532 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-56ab7391-b7dd-4022-a247-d8a7fa8c2241 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: 8a3b02c0-6943-45dc-9086-16ff29536118] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:34:00.267639 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-56ab7391-b7dd-4022-a247-d8a7fa8c2241 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:00.268447 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-56ab7391-b7dd-4022-a247-d8a7fa8c2241 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:00.270219 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-56ab7391-b7dd-4022-a247-d8a7fa8c2241 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:00.271464 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-56ab7391-b7dd-4022-a247-d8a7fa8c2241 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:00.538123 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-56ab7391-b7dd-4022-a247-d8a7fa8c2241 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:00.558326 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-56ab7391-b7dd-4022-a247-d8a7fa8c2241 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118" status: 200 len: 1564 microversion: 2.1 time: 0.329890 May 19 13:34:00.562742 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 220/415] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:34:00 2022] GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118 => generated 1564 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:34:00.582234 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-0c7549e9-5c22-45d0-b2fa-f0c369558c04 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:34:00.583501 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-0c7549e9-5c22-45d0-b2fa-f0c369558c04 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: 8a3b02c0-6943-45dc-9086-16ff29536118] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:34:00.620769 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-0c7549e9-5c22-45d0-b2fa-f0c369558c04 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:00.621625 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-0c7549e9-5c22-45d0-b2fa-f0c369558c04 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:00.623901 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-0c7549e9-5c22-45d0-b2fa-f0c369558c04 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:00.625336 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-0c7549e9-5c22-45d0-b2fa-f0c369558c04 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:00.814290 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-0c7549e9-5c22-45d0-b2fa-f0c369558c04 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.238896 May 19 13:34:00.815764 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 196/416] 10.222.0.24 () {58 vars in 1274 bytes} [Thu May 19 13:34:00 2022] GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118/os-interface => generated 284 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:34:00.864446 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-0173d7db-9be6-46a9-bdc8-44693a6cbe2a tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:34:00.865639 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-0173d7db-9be6-46a9-bdc8-44693a6cbe2a tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:34:00.873819 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-0173d7db-9be6-46a9-bdc8-44693a6cbe2a tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:00.874669 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-0173d7db-9be6-46a9-bdc8-44693a6cbe2a tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:00.876518 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-0173d7db-9be6-46a9-bdc8-44693a6cbe2a tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:00.877155 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-0173d7db-9be6-46a9-bdc8-44693a6cbe2a tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:01.187840 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-0173d7db-9be6-46a9-bdc8-44693a6cbe2a tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:01.198897 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-0173d7db-9be6-46a9-bdc8-44693a6cbe2a tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:01.202504 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-0173d7db-9be6-46a9-bdc8-44693a6cbe2a tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:01.203714 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-0173d7db-9be6-46a9-bdc8-44693a6cbe2a tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1751 microversion: 2.20 time: 0.352456 May 19 13:34:01.204276 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 221/417] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:34:00 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1751 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:34:01.888382 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-49f27db8-0ae8-495a-bba2-f85896fc7431 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1594261357"}} {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:34:01.889885 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-49f27db8-0ae8-495a-bba2-f85896fc7431 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] [instance: c97e472c-540e-4bd5-abaf-d7dadac8c6be] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:34:01.905016 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-49f27db8-0ae8-495a-bba2-f85896fc7431 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:01.905514 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-49f27db8-0ae8-495a-bba2-f85896fc7431 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:01.909133 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-49f27db8-0ae8-495a-bba2-f85896fc7431 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:01.909778 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-49f27db8-0ae8-495a-bba2-f85896fc7431 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:02.223237 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-fb9314f7-2d64-4951-8825-42f4c9fb6a80 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:34:02.224915 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-fb9314f7-2d64-4951-8825-42f4c9fb6a80 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:34:02.233875 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-fb9314f7-2d64-4951-8825-42f4c9fb6a80 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:02.234588 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-fb9314f7-2d64-4951-8825-42f4c9fb6a80 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:02.235607 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-fb9314f7-2d64-4951-8825-42f4c9fb6a80 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:02.236678 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-fb9314f7-2d64-4951-8825-42f4c9fb6a80 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:02.306617 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.network.security_group_api [None req-49f27db8-0ae8-495a-bba2-f85896fc7431 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Adding security group aecfda95-6538-4bd0-ae3e-18f1d8f9a9b8 to port 97ed1b45-3101-4569-a101-5346f9044405 May 19 13:34:02.516023 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-fb9314f7-2d64-4951-8825-42f4c9fb6a80 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:02.520419 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:34:02.534335 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-fb9314f7-2d64-4951-8825-42f4c9fb6a80 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:02.546871 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-fb9314f7-2d64-4951-8825-42f4c9fb6a80 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:02.552538 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-fb9314f7-2d64-4951-8825-42f4c9fb6a80 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1751 microversion: 2.20 time: 0.333995 May 19 13:34:02.557238 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 222/418] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:34:02 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1751 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 13:34:03.444274 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-49f27db8-0ae8-495a-bba2-f85896fc7431 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] 10.222.0.24 "POST /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be/action" status: 202 len: 0 microversion: 2.1 time: 1.560742 May 19 13:34:03.445496 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 197/419] 10.222.0.24 () {60 vars in 1277 bytes} [Thu May 19 13:34:01 2022] POST /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be/action => generated 0 bytes in 1563 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 13:34:03.454141 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-615125f4-134b-4db9-85b6-02caf5647ee3 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:34:03.461219 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [req-d8fb5275-4337-4366-82db-6be2dc210b93 req-ccbb5939-0d4a-4e68-a5f2-2736b721c678 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c97e472c-540e-4bd5-abaf-d7dadac8c6be", "tag": "97ed1b45-3101-4569-a101-5346f9044405"}]} {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:34:03.461724 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-615125f4-134b-4db9-85b6-02caf5647ee3 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] [instance: c97e472c-540e-4bd5-abaf-d7dadac8c6be] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:34:03.481178 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [req-d8fb5275-4337-4366-82db-6be2dc210b93 req-ccbb5939-0d4a-4e68-a5f2-2736b721c678 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:03.483358 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-615125f4-134b-4db9-85b6-02caf5647ee3 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:03.484544 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-615125f4-134b-4db9-85b6-02caf5647ee3 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:03.486000 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-615125f4-134b-4db9-85b6-02caf5647ee3 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:03.489571 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [req-d8fb5275-4337-4366-82db-6be2dc210b93 req-ccbb5939-0d4a-4e68-a5f2-2736b721c678 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:03.518381 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-615125f4-134b-4db9-85b6-02caf5647ee3 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:03.573283 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.compute.server_external_events [req-d8fb5275-4337-4366-82db-6be2dc210b93 req-ccbb5939-0d4a-4e68-a5f2-2736b721c678 service nova] Creating event network-changed:97ed1b45-3101-4569-a101-5346f9044405 for instance c97e472c-540e-4bd5-abaf-d7dadac8c6be on hv-cinder-84112 May 19 13:34:03.593571 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [req-d8fb5275-4337-4366-82db-6be2dc210b93 req-ccbb5939-0d4a-4e68-a5f2-2736b721c678 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135544 May 19 13:34:03.596707 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 198/420] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:34:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:34:03.604592 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-ae7cb4f7-1f86-495c-90dc-e683f60098b4 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:34:03.608996 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-ae7cb4f7-1f86-495c-90dc-e683f60098b4 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:34:03.637838 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-ae7cb4f7-1f86-495c-90dc-e683f60098b4 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:03.638587 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-ae7cb4f7-1f86-495c-90dc-e683f60098b4 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:03.639565 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-ae7cb4f7-1f86-495c-90dc-e683f60098b4 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:03.647390 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-ae7cb4f7-1f86-495c-90dc-e683f60098b4 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:04.018159 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-ae7cb4f7-1f86-495c-90dc-e683f60098b4 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:04.035006 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-ae7cb4f7-1f86-495c-90dc-e683f60098b4 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:04.043211 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-ae7cb4f7-1f86-495c-90dc-e683f60098b4 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:04.044735 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-ae7cb4f7-1f86-495c-90dc-e683f60098b4 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1751 microversion: 2.20 time: 0.446678 May 19 13:34:04.045662 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 199/421] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:34:03 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1751 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:34:04.100281 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-615125f4-134b-4db9-85b6-02caf5647ee3 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11df35c0e4541deaea0494759301a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '510387333865470196f9be30ef62395c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:04.115065 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-615125f4-134b-4db9-85b6-02caf5647ee3 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] 10.222.0.24 "GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be" status: 200 len: 1758 microversion: 2.1 time: 0.662006 May 19 13:34:04.129887 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 223/422] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:34:03 2022] GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be => generated 1758 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:34:05.062940 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-6a161325-79d0-4a07-b061-0224fbda9849 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:34:05.064189 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-6a161325-79d0-4a07-b061-0224fbda9849 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:34:05.071131 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-6a161325-79d0-4a07-b061-0224fbda9849 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:05.071842 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-6a161325-79d0-4a07-b061-0224fbda9849 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:05.072780 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-6a161325-79d0-4a07-b061-0224fbda9849 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:05.073367 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-6a161325-79d0-4a07-b061-0224fbda9849 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:05.258624 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-6a161325-79d0-4a07-b061-0224fbda9849 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:05.271785 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-6a161325-79d0-4a07-b061-0224fbda9849 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:05.274267 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-6a161325-79d0-4a07-b061-0224fbda9849 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:05.275874 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-6a161325-79d0-4a07-b061-0224fbda9849 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1751 microversion: 2.20 time: 0.217352 May 19 13:34:05.276595 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 200/423] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:34:05 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1751 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:34:05.613089 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [req-2d6e0995-931a-4baf-b191-42ce10ce744a req-0ceff257-8291-4865-8602-61624fb77bec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a3b02c0-6943-45dc-9086-16ff29536118", "tag": "3d603fe2-3873-40ee-9c1d-9815f7c92788"}]} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:34:05.623137 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-2d6e0995-931a-4baf-b191-42ce10ce744a req-0ceff257-8291-4865-8602-61624fb77bec service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:05.623542 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-2d6e0995-931a-4baf-b191-42ce10ce744a req-0ceff257-8291-4865-8602-61624fb77bec service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:05.636614 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.compute.server_external_events [req-2d6e0995-931a-4baf-b191-42ce10ce744a req-0ceff257-8291-4865-8602-61624fb77bec service nova] Creating event network-changed:3d603fe2-3873-40ee-9c1d-9815f7c92788 for instance 8a3b02c0-6943-45dc-9086-16ff29536118 on hv-cinder-84112 May 19 13:34:05.642521 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [req-2d6e0995-931a-4baf-b191-42ce10ce744a req-0ceff257-8291-4865-8602-61624fb77bec service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033060 May 19 13:34:05.643065 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 224/424] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:34:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:34:06.295846 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-5833d272-ac38-43e1-ac9f-018b56aecaf7 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:34:06.296609 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-5833d272-ac38-43e1-ac9f-018b56aecaf7 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:34:06.303121 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-5833d272-ac38-43e1-ac9f-018b56aecaf7 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:06.303689 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-5833d272-ac38-43e1-ac9f-018b56aecaf7 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:06.304553 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-5833d272-ac38-43e1-ac9f-018b56aecaf7 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:06.305196 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-5833d272-ac38-43e1-ac9f-018b56aecaf7 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:06.507490 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-5833d272-ac38-43e1-ac9f-018b56aecaf7 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:06.517757 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-5833d272-ac38-43e1-ac9f-018b56aecaf7 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:06.520248 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-5833d272-ac38-43e1-ac9f-018b56aecaf7 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:06.521765 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-5833d272-ac38-43e1-ac9f-018b56aecaf7 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1753 microversion: 2.20 time: 0.230948 May 19 13:34:06.522340 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 201/425] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:34:06 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1753 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:34:07.548426 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-c34ac796-2173-408e-b5aa-1429f6db5ef0 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:34:07.551949 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-c34ac796-2173-408e-b5aa-1429f6db5ef0 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:34:07.574282 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-c34ac796-2173-408e-b5aa-1429f6db5ef0 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:07.576007 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-c34ac796-2173-408e-b5aa-1429f6db5ef0 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:07.577319 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-c34ac796-2173-408e-b5aa-1429f6db5ef0 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:07.577785 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-c34ac796-2173-408e-b5aa-1429f6db5ef0 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:07.763429 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-c34ac796-2173-408e-b5aa-1429f6db5ef0 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:07.772542 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-c34ac796-2173-408e-b5aa-1429f6db5ef0 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:07.774088 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-c34ac796-2173-408e-b5aa-1429f6db5ef0 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:07.775479 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-c34ac796-2173-408e-b5aa-1429f6db5ef0 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1753 microversion: 2.20 time: 0.238825 May 19 13:34:07.776549 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 225/426] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:34:07 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1753 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:34:08.799979 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-7f1debfa-6966-457a-9db8-b3ec66140aa7 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:34:08.801445 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-7f1debfa-6966-457a-9db8-b3ec66140aa7 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:34:08.805158 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_api:SELECT=88 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:34:08.827171 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-7f1debfa-6966-457a-9db8-b3ec66140aa7 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:08.827689 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-7f1debfa-6966-457a-9db8-b3ec66140aa7 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:08.828555 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-7f1debfa-6966-457a-9db8-b3ec66140aa7 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:08.829061 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-7f1debfa-6966-457a-9db8-b3ec66140aa7 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:08.985955 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-7f1debfa-6966-457a-9db8-b3ec66140aa7 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:08.998650 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-7f1debfa-6966-457a-9db8-b3ec66140aa7 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:09.000755 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-7f1debfa-6966-457a-9db8-b3ec66140aa7 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:09.002149 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-7f1debfa-6966-457a-9db8-b3ec66140aa7 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1809 microversion: 2.20 time: 0.207358 May 19 13:34:09.002718 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 202/427] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:34:08 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1809 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:34:10.022606 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-c5ed2ced-25e4-4b85-bc7f-24d42201103f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:34:10.023882 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-c5ed2ced-25e4-4b85-bc7f-24d42201103f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:34:10.036156 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-c5ed2ced-25e4-4b85-bc7f-24d42201103f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:10.036974 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-c5ed2ced-25e4-4b85-bc7f-24d42201103f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:10.039715 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-c5ed2ced-25e4-4b85-bc7f-24d42201103f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:10.040324 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-c5ed2ced-25e4-4b85-bc7f-24d42201103f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:10.400144 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-c5ed2ced-25e4-4b85-bc7f-24d42201103f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:10.410355 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-c5ed2ced-25e4-4b85-bc7f-24d42201103f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:10.412788 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-c5ed2ced-25e4-4b85-bc7f-24d42201103f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:10.414599 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-c5ed2ced-25e4-4b85-bc7f-24d42201103f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1809 microversion: 2.20 time: 0.396127 May 19 13:34:10.415476 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 226/428] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:34:10 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1809 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:34:11.434197 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-e5d725f4-3e62-468c-9975-5b35a1754f90 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:34:11.434927 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-e5d725f4-3e62-468c-9975-5b35a1754f90 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:34:11.443809 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-207c9dab-7887-43f0-b3fb-5fa5f24a4713 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "64187414-1956-4fb7-906a-e2d20858221c", "device": "/dev/sdb"}} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:34:11.445661 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-207c9dab-7887-43f0-b3fb-5fa5f24a4713 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] [instance: 3dc7fd1b-e5d5-4f93-bcff-94b90ed75138] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:34:11.448256 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:34:11.460048 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-e5d725f4-3e62-468c-9975-5b35a1754f90 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:11.460668 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-e5d725f4-3e62-468c-9975-5b35a1754f90 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:11.461782 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-e5d725f4-3e62-468c-9975-5b35a1754f90 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:11.462856 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-e5d725f4-3e62-468c-9975-5b35a1754f90 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:11.464646 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-207c9dab-7887-43f0-b3fb-5fa5f24a4713 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:11.465644 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-207c9dab-7887-43f0-b3fb-5fa5f24a4713 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:11.465949 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-207c9dab-7887-43f0-b3fb-5fa5f24a4713 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:11.466381 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-207c9dab-7887-43f0-b3fb-5fa5f24a4713 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:11.684366 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-e5d725f4-3e62-468c-9975-5b35a1754f90 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:11.695596 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-e5d725f4-3e62-468c-9975-5b35a1754f90 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:11.700171 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-e5d725f4-3e62-468c-9975-5b35a1754f90 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:11.702007 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-e5d725f4-3e62-468c-9975-5b35a1754f90 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1809 microversion: 2.20 time: 0.271728 May 19 13:34:11.703144 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 203/429] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:34:11 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1809 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:34:12.721106 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-032657ff-6ab1-4150-a4da-d014edb87f29 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:34:12.722504 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-032657ff-6ab1-4150-a4da-d014edb87f29 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:34:12.745864 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-032657ff-6ab1-4150-a4da-d014edb87f29 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:12.750826 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-032657ff-6ab1-4150-a4da-d014edb87f29 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:12.752105 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-032657ff-6ab1-4150-a4da-d014edb87f29 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:12.752762 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-032657ff-6ab1-4150-a4da-d014edb87f29 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:12.955200 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-032657ff-6ab1-4150-a4da-d014edb87f29 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:13.033070 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-032657ff-6ab1-4150-a4da-d014edb87f29 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:13.041789 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-032657ff-6ab1-4150-a4da-d014edb87f29 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:13.041789 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-032657ff-6ab1-4150-a4da-d014edb87f29 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1809 microversion: 2.20 time: 0.318818 May 19 13:34:13.041789 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 204/430] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:34:12 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1809 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 13:34:14.055611 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-4c0ca1fd-36ec-4bb3-8664-c2803006f058 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:34:14.060675 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-4c0ca1fd-36ec-4bb3-8664-c2803006f058 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:34:14.068522 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-4c0ca1fd-36ec-4bb3-8664-c2803006f058 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:14.069081 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-4c0ca1fd-36ec-4bb3-8664-c2803006f058 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:14.073914 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-4c0ca1fd-36ec-4bb3-8664-c2803006f058 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:14.073914 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-4c0ca1fd-36ec-4bb3-8664-c2803006f058 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:14.102318 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_cell1:SELECT=100 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:34:14.272742 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-4c0ca1fd-36ec-4bb3-8664-c2803006f058 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:14.286593 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-4c0ca1fd-36ec-4bb3-8664-c2803006f058 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:14.288963 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-4c0ca1fd-36ec-4bb3-8664-c2803006f058 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:14.290599 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-4c0ca1fd-36ec-4bb3-8664-c2803006f058 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1809 microversion: 2.20 time: 0.239730 May 19 13:34:14.291905 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 205/431] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:34:14 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1809 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 13:34:15.312728 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-8ea9337c-26af-48cd-88e3-544005a3e0d2 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:34:15.313478 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-8ea9337c-26af-48cd-88e3-544005a3e0d2 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:34:15.324214 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-8ea9337c-26af-48cd-88e3-544005a3e0d2 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:15.324773 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-8ea9337c-26af-48cd-88e3-544005a3e0d2 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:15.325667 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-8ea9337c-26af-48cd-88e3-544005a3e0d2 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:15.326126 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-8ea9337c-26af-48cd-88e3-544005a3e0d2 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:15.668638 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-8ea9337c-26af-48cd-88e3-544005a3e0d2 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:15.678848 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-8ea9337c-26af-48cd-88e3-544005a3e0d2 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:15.680741 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-8ea9337c-26af-48cd-88e3-544005a3e0d2 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:15.682953 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-8ea9337c-26af-48cd-88e3-544005a3e0d2 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1809 microversion: 2.20 time: 0.375011 May 19 13:34:15.683625 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 206/432] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:34:15 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1809 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:34:16.704603 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-a8592ec6-9992-4e27-b07a-c751c257d166 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:34:16.706211 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-a8592ec6-9992-4e27-b07a-c751c257d166 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:34:16.720799 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-a8592ec6-9992-4e27-b07a-c751c257d166 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:16.722551 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-a8592ec6-9992-4e27-b07a-c751c257d166 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:16.724694 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-a8592ec6-9992-4e27-b07a-c751c257d166 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:16.726020 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-a8592ec6-9992-4e27-b07a-c751c257d166 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:16.919486 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-a8592ec6-9992-4e27-b07a-c751c257d166 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:16.928529 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-a8592ec6-9992-4e27-b07a-c751c257d166 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:16.932732 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-a8592ec6-9992-4e27-b07a-c751c257d166 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:16.932732 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-a8592ec6-9992-4e27-b07a-c751c257d166 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1809 microversion: 2.20 time: 0.232296 May 19 13:34:16.943643 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 207/433] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:34:16 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1809 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:34:17.951450 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-850c900a-0ba9-466a-b044-75fa7df9ea13 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:34:17.952155 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-850c900a-0ba9-466a-b044-75fa7df9ea13 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:34:17.965314 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-850c900a-0ba9-466a-b044-75fa7df9ea13 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:17.965448 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-850c900a-0ba9-466a-b044-75fa7df9ea13 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:17.966479 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-850c900a-0ba9-466a-b044-75fa7df9ea13 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:17.967140 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-850c900a-0ba9-466a-b044-75fa7df9ea13 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:18.113920 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-850c900a-0ba9-466a-b044-75fa7df9ea13 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:18.123919 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-850c900a-0ba9-466a-b044-75fa7df9ea13 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:18.125481 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-850c900a-0ba9-466a-b044-75fa7df9ea13 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:18.126987 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-850c900a-0ba9-466a-b044-75fa7df9ea13 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1809 microversion: 2.20 time: 0.180263 May 19 13:34:18.127693 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 208/434] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:34:17 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1809 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 13:34:19.145869 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-6fad8232-84aa-4af3-801e-7b6564b24e6b tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:34:19.146611 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-6fad8232-84aa-4af3-801e-7b6564b24e6b tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:34:19.154499 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-6fad8232-84aa-4af3-801e-7b6564b24e6b tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:19.154945 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-6fad8232-84aa-4af3-801e-7b6564b24e6b tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:19.155705 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-6fad8232-84aa-4af3-801e-7b6564b24e6b tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:19.156126 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-6fad8232-84aa-4af3-801e-7b6564b24e6b tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:19.315866 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-6fad8232-84aa-4af3-801e-7b6564b24e6b tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:19.324868 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-6fad8232-84aa-4af3-801e-7b6564b24e6b tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:19.326503 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-6fad8232-84aa-4af3-801e-7b6564b24e6b tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:19.327563 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-6fad8232-84aa-4af3-801e-7b6564b24e6b tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1809 microversion: 2.20 time: 0.186316 May 19 13:34:19.328384 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 209/435] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:34:19 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1809 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 13:34:20.346856 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-391fedb8-7748-415c-b9c5-2e681b6eab23 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:34:20.347548 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-391fedb8-7748-415c-b9c5-2e681b6eab23 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:34:20.354586 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-391fedb8-7748-415c-b9c5-2e681b6eab23 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:20.355038 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-391fedb8-7748-415c-b9c5-2e681b6eab23 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:20.355935 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-391fedb8-7748-415c-b9c5-2e681b6eab23 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:20.356552 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-391fedb8-7748-415c-b9c5-2e681b6eab23 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:20.499412 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-391fedb8-7748-415c-b9c5-2e681b6eab23 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:20.507923 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-391fedb8-7748-415c-b9c5-2e681b6eab23 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:20.509512 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-391fedb8-7748-415c-b9c5-2e681b6eab23 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:20.510744 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-391fedb8-7748-415c-b9c5-2e681b6eab23 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1809 microversion: 2.20 time: 0.168358 May 19 13:34:20.511292 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 210/436] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:34:20 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:34:20.541499 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-207c9dab-7887-43f0-b3fb-5fa5f24a4713 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] 10.222.0.24 "POST /compute/v2.1/servers/3dc7fd1b-e5d5-4f93-bcff-94b90ed75138/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 9.101728 May 19 13:34:20.542156 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 227/437] 10.222.0.24 () {60 vars in 1322 bytes} [Thu May 19 13:34:11 2022] POST /compute/v2.1/servers/3dc7fd1b-e5d5-4f93-bcff-94b90ed75138/os-volume_attachments => generated 194 bytes in 9103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:34:21.529039 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-50b063dc-1256-4ce8-a05f-22e938128703 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:34:21.529675 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-50b063dc-1256-4ce8-a05f-22e938128703 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:34:21.536907 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-50b063dc-1256-4ce8-a05f-22e938128703 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:21.537355 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-50b063dc-1256-4ce8-a05f-22e938128703 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:21.538151 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-50b063dc-1256-4ce8-a05f-22e938128703 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:21.538613 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-50b063dc-1256-4ce8-a05f-22e938128703 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:21.676958 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-50b063dc-1256-4ce8-a05f-22e938128703 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:21.685945 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-50b063dc-1256-4ce8-a05f-22e938128703 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:21.687440 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-50b063dc-1256-4ce8-a05f-22e938128703 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:21.688635 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-50b063dc-1256-4ce8-a05f-22e938128703 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1809 microversion: 2.20 time: 0.163828 May 19 13:34:21.689191 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 211/438] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:34:21 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:34:22.704429 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_api:SELECT=1 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:34:22.708958 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-2b05c12d-013e-454f-a226-188846690c77 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:34:22.709922 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-2b05c12d-013e-454f-a226-188846690c77 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:34:22.719245 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-2b05c12d-013e-454f-a226-188846690c77 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:22.719704 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-2b05c12d-013e-454f-a226-188846690c77 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:22.720492 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-2b05c12d-013e-454f-a226-188846690c77 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:22.720929 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-2b05c12d-013e-454f-a226-188846690c77 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:22.853211 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-2b05c12d-013e-454f-a226-188846690c77 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:22.862437 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-2b05c12d-013e-454f-a226-188846690c77 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:22.863947 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-2b05c12d-013e-454f-a226-188846690c77 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:22.865127 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-2b05c12d-013e-454f-a226-188846690c77 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1809 microversion: 2.20 time: 0.162166 May 19 13:34:22.865741 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 228/439] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:34:22 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:34:23.883365 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-482d55e1-ce53-4af3-8a0b-80ea64346bb1 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:34:23.883978 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-482d55e1-ce53-4af3-8a0b-80ea64346bb1 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:34:23.891368 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-482d55e1-ce53-4af3-8a0b-80ea64346bb1 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:23.891810 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-482d55e1-ce53-4af3-8a0b-80ea64346bb1 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:23.892693 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-482d55e1-ce53-4af3-8a0b-80ea64346bb1 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:23.893124 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-482d55e1-ce53-4af3-8a0b-80ea64346bb1 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:24.037904 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-482d55e1-ce53-4af3-8a0b-80ea64346bb1 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:24.047612 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-482d55e1-ce53-4af3-8a0b-80ea64346bb1 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:24.049116 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-482d55e1-ce53-4af3-8a0b-80ea64346bb1 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:24.050297 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-482d55e1-ce53-4af3-8a0b-80ea64346bb1 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1809 microversion: 2.20 time: 0.171066 May 19 13:34:24.050864 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 212/440] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:34:23 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:34:25.071408 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-8a744d55-c72e-409d-9b31-b1008c2bd197 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:34:25.072285 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-8a744d55-c72e-409d-9b31-b1008c2bd197 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:34:25.080839 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-8a744d55-c72e-409d-9b31-b1008c2bd197 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:25.081608 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-8a744d55-c72e-409d-9b31-b1008c2bd197 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:25.082851 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-8a744d55-c72e-409d-9b31-b1008c2bd197 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:25.083619 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-8a744d55-c72e-409d-9b31-b1008c2bd197 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:25.220424 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-8a744d55-c72e-409d-9b31-b1008c2bd197 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:25.229029 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-8a744d55-c72e-409d-9b31-b1008c2bd197 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:25.230572 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-8a744d55-c72e-409d-9b31-b1008c2bd197 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:25.231715 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-8a744d55-c72e-409d-9b31-b1008c2bd197 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1809 microversion: 2.20 time: 0.164911 May 19 13:34:25.232300 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 229/441] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:34:25 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:34:26.259763 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-7db89743-db8c-4fd8-a485-bfd9104fdc0a tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:34:26.260863 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-7db89743-db8c-4fd8-a485-bfd9104fdc0a tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:34:26.268597 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-7db89743-db8c-4fd8-a485-bfd9104fdc0a tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:26.269053 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-7db89743-db8c-4fd8-a485-bfd9104fdc0a tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:26.269846 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-7db89743-db8c-4fd8-a485-bfd9104fdc0a tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:26.270274 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-7db89743-db8c-4fd8-a485-bfd9104fdc0a tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:26.411870 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-7db89743-db8c-4fd8-a485-bfd9104fdc0a tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:26.420907 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-7db89743-db8c-4fd8-a485-bfd9104fdc0a tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:26.422415 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-7db89743-db8c-4fd8-a485-bfd9104fdc0a tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:26.423549 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-7db89743-db8c-4fd8-a485-bfd9104fdc0a tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1809 microversion: 2.20 time: 0.170456 May 19 13:34:26.424134 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 213/442] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:34:26 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:34:27.451899 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-9b4b02cd-ae68-4116-aa56-fc9d4f3ee4c5 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:34:27.452879 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-9b4b02cd-ae68-4116-aa56-fc9d4f3ee4c5 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:34:27.464214 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-9b4b02cd-ae68-4116-aa56-fc9d4f3ee4c5 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:27.464961 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-9b4b02cd-ae68-4116-aa56-fc9d4f3ee4c5 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:27.466324 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-9b4b02cd-ae68-4116-aa56-fc9d4f3ee4c5 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:27.466759 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-9b4b02cd-ae68-4116-aa56-fc9d4f3ee4c5 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:27.607858 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-9b4b02cd-ae68-4116-aa56-fc9d4f3ee4c5 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:27.616942 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-9b4b02cd-ae68-4116-aa56-fc9d4f3ee4c5 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:27.618476 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-9b4b02cd-ae68-4116-aa56-fc9d4f3ee4c5 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:27.619635 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-9b4b02cd-ae68-4116-aa56-fc9d4f3ee4c5 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1809 microversion: 2.20 time: 0.174420 May 19 13:34:27.620205 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 230/443] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:34:27 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:34:28.642031 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-ea9c4966-c7c2-40c6-9ded-26aa13149cf4 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:34:28.642951 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-ea9c4966-c7c2-40c6-9ded-26aa13149cf4 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:34:28.652082 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-ea9c4966-c7c2-40c6-9ded-26aa13149cf4 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:28.652683 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-ea9c4966-c7c2-40c6-9ded-26aa13149cf4 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:28.654349 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-ea9c4966-c7c2-40c6-9ded-26aa13149cf4 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:28.654977 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-ea9c4966-c7c2-40c6-9ded-26aa13149cf4 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:28.795712 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-ea9c4966-c7c2-40c6-9ded-26aa13149cf4 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:28.805096 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-ea9c4966-c7c2-40c6-9ded-26aa13149cf4 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:28.806617 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-ea9c4966-c7c2-40c6-9ded-26aa13149cf4 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:28.807766 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-ea9c4966-c7c2-40c6-9ded-26aa13149cf4 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1809 microversion: 2.20 time: 0.171633 May 19 13:34:28.808313 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 214/444] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:34:28 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:34:29.831468 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-223b5481-6cf1-429f-aeb0-eedbb2ce7fdc tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:34:29.832276 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-223b5481-6cf1-429f-aeb0-eedbb2ce7fdc tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:34:29.842674 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-223b5481-6cf1-429f-aeb0-eedbb2ce7fdc tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:29.843117 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-223b5481-6cf1-429f-aeb0-eedbb2ce7fdc tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:29.843892 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-223b5481-6cf1-429f-aeb0-eedbb2ce7fdc tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:29.844320 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-223b5481-6cf1-429f-aeb0-eedbb2ce7fdc tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:29.983994 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-223b5481-6cf1-429f-aeb0-eedbb2ce7fdc tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:29.992727 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-223b5481-6cf1-429f-aeb0-eedbb2ce7fdc tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:29.994252 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-223b5481-6cf1-429f-aeb0-eedbb2ce7fdc tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:29.995395 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-223b5481-6cf1-429f-aeb0-eedbb2ce7fdc tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1809 microversion: 2.20 time: 0.170638 May 19 13:34:29.995952 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 231/445] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:34:29 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:34:31.018230 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-db34d468-05f8-4e36-b30d-41e724be8c41 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:34:31.019306 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-db34d468-05f8-4e36-b30d-41e724be8c41 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:34:31.029609 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-db34d468-05f8-4e36-b30d-41e724be8c41 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:31.030062 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-db34d468-05f8-4e36-b30d-41e724be8c41 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:31.030818 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-db34d468-05f8-4e36-b30d-41e724be8c41 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:31.031241 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-db34d468-05f8-4e36-b30d-41e724be8c41 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:31.174957 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-db34d468-05f8-4e36-b30d-41e724be8c41 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:31.187209 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-db34d468-05f8-4e36-b30d-41e724be8c41 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:31.188720 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-db34d468-05f8-4e36-b30d-41e724be8c41 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:31.189918 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-db34d468-05f8-4e36-b30d-41e724be8c41 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1809 microversion: 2.20 time: 0.178513 May 19 13:34:31.190477 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 215/446] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:34:31 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1809 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:34:32.212207 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-83601804-85d1-4132-9ef1-59e993ef62b1 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:34:32.213186 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-83601804-85d1-4132-9ef1-59e993ef62b1 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:34:32.224676 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-83601804-85d1-4132-9ef1-59e993ef62b1 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:32.225394 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-83601804-85d1-4132-9ef1-59e993ef62b1 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:32.226729 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-83601804-85d1-4132-9ef1-59e993ef62b1 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:32.227430 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-83601804-85d1-4132-9ef1-59e993ef62b1 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:32.370810 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-83601804-85d1-4132-9ef1-59e993ef62b1 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:32.379682 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-83601804-85d1-4132-9ef1-59e993ef62b1 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:32.381178 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-83601804-85d1-4132-9ef1-59e993ef62b1 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:32.382383 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-83601804-85d1-4132-9ef1-59e993ef62b1 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1809 microversion: 2.20 time: 0.176759 May 19 13:34:32.382941 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 232/447] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:34:32 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1809 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:34:33.404428 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-45a3f98b-9fe6-420e-bea1-66886013350a tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:34:33.404993 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-45a3f98b-9fe6-420e-bea1-66886013350a tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:34:33.411582 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-45a3f98b-9fe6-420e-bea1-66886013350a tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:33.412024 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-45a3f98b-9fe6-420e-bea1-66886013350a tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:33.412770 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-45a3f98b-9fe6-420e-bea1-66886013350a tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:33.413193 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-45a3f98b-9fe6-420e-bea1-66886013350a tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:33.547480 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-45a3f98b-9fe6-420e-bea1-66886013350a tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:33.556810 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-45a3f98b-9fe6-420e-bea1-66886013350a tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:33.558462 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-45a3f98b-9fe6-420e-bea1-66886013350a tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:33.559826 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-45a3f98b-9fe6-420e-bea1-66886013350a tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1809 microversion: 2.20 time: 0.161538 May 19 13:34:33.560439 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 216/448] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:34:33 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:34:34.582351 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-9bf78e20-487d-4982-93b2-c7221d156e57 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:34:34.583214 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-9bf78e20-487d-4982-93b2-c7221d156e57 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:34:34.594766 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-9bf78e20-487d-4982-93b2-c7221d156e57 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:34.595503 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-9bf78e20-487d-4982-93b2-c7221d156e57 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:34.596750 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-9bf78e20-487d-4982-93b2-c7221d156e57 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:34.597521 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-9bf78e20-487d-4982-93b2-c7221d156e57 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:34.601812 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:34:34.741211 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-9bf78e20-487d-4982-93b2-c7221d156e57 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:34.750318 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-9bf78e20-487d-4982-93b2-c7221d156e57 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:34.751832 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-9bf78e20-487d-4982-93b2-c7221d156e57 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:34.752977 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-9bf78e20-487d-4982-93b2-c7221d156e57 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1809 microversion: 2.20 time: 0.177472 May 19 13:34:34.753521 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 233/449] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:34:34 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:34:35.771784 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-d76f6701-ccea-47a2-a263-38f3787e9a42 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:34:35.772342 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-d76f6701-ccea-47a2-a263-38f3787e9a42 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:34:35.779897 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-d76f6701-ccea-47a2-a263-38f3787e9a42 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:35.780276 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-d76f6701-ccea-47a2-a263-38f3787e9a42 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:35.781039 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-d76f6701-ccea-47a2-a263-38f3787e9a42 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:35.781497 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-d76f6701-ccea-47a2-a263-38f3787e9a42 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:35.864675 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [req-566b0bac-5064-4aad-9dbc-fd79fb5250f3 req-f41aded8-366c-4124-9857-5ef8ae5ff8aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "323322ec-2e2e-424b-a411-8a34069bcf10", "name": "network-vif-plugged", "status": "completed", "tag": "1ae6b782-184e-4357-ab26-9a0648e0a6a3"}]} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:34:35.874680 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-566b0bac-5064-4aad-9dbc-fd79fb5250f3 req-f41aded8-366c-4124-9857-5ef8ae5ff8aa service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:35.875208 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-566b0bac-5064-4aad-9dbc-fd79fb5250f3 req-f41aded8-366c-4124-9857-5ef8ae5ff8aa service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:35.891418 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.compute.server_external_events [req-566b0bac-5064-4aad-9dbc-fd79fb5250f3 req-f41aded8-366c-4124-9857-5ef8ae5ff8aa service nova] Creating event network-vif-plugged:1ae6b782-184e-4357-ab26-9a0648e0a6a3 for instance 323322ec-2e2e-424b-a411-8a34069bcf10 on hv-cinder-84112 May 19 13:34:35.896537 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [req-566b0bac-5064-4aad-9dbc-fd79fb5250f3 req-f41aded8-366c-4124-9857-5ef8ae5ff8aa service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035578 May 19 13:34:35.897143 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 234/450] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:34:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 13:34:35.925554 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-d76f6701-ccea-47a2-a263-38f3787e9a42 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:35.934214 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-d76f6701-ccea-47a2-a263-38f3787e9a42 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:35.935793 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-d76f6701-ccea-47a2-a263-38f3787e9a42 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:35.937013 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-d76f6701-ccea-47a2-a263-38f3787e9a42 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1809 microversion: 2.20 time: 0.169416 May 19 13:34:35.937695 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 217/451] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:34:35 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:34:36.430290 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-da256ffc-8a1f-4509-9f88-a011bf053b3b tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:34:36.431377 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-da256ffc-8a1f-4509-9f88-a011bf053b3b tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] [instance: c97e472c-540e-4bd5-abaf-d7dadac8c6be] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:34:36.438599 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-da256ffc-8a1f-4509-9f88-a011bf053b3b tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:36.439068 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-da256ffc-8a1f-4509-9f88-a011bf053b3b tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:36.439810 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-da256ffc-8a1f-4509-9f88-a011bf053b3b tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:36.440242 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-da256ffc-8a1f-4509-9f88-a011bf053b3b tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:36.522316 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-da256ffc-8a1f-4509-9f88-a011bf053b3b tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] 10.222.0.24 "POST /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be/action" status: 202 len: 0 microversion: 2.1 time: 0.096359 May 19 13:34:36.522855 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 235/452] 10.222.0.24 () {60 vars in 1277 bytes} [Thu May 19 13:34:36 2022] POST /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 13:34:36.532799 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-3e6fd0bc-f3cd-41ff-b150-27ed7460dc5d tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:34:36.533529 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-3e6fd0bc-f3cd-41ff-b150-27ed7460dc5d tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] [instance: c97e472c-540e-4bd5-abaf-d7dadac8c6be] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:34:36.539771 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-3e6fd0bc-f3cd-41ff-b150-27ed7460dc5d tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:36.540247 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-3e6fd0bc-f3cd-41ff-b150-27ed7460dc5d tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:36.540999 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-3e6fd0bc-f3cd-41ff-b150-27ed7460dc5d tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:36.541446 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-3e6fd0bc-f3cd-41ff-b150-27ed7460dc5d tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:36.695849 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-3e6fd0bc-f3cd-41ff-b150-27ed7460dc5d tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11df35c0e4541deaea0494759301a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '510387333865470196f9be30ef62395c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:36.705657 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-3e6fd0bc-f3cd-41ff-b150-27ed7460dc5d tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] 10.222.0.24 "GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be" status: 200 len: 1750 microversion: 2.1 time: 0.176673 May 19 13:34:36.706226 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 218/453] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:34:36 2022] GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be => generated 1750 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:34:36.958903 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-73f5d334-8eee-480d-b3b8-2201ab28f412 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:34:36.959493 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-73f5d334-8eee-480d-b3b8-2201ab28f412 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:34:36.970898 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-73f5d334-8eee-480d-b3b8-2201ab28f412 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:36.971524 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-73f5d334-8eee-480d-b3b8-2201ab28f412 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:36.972478 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-73f5d334-8eee-480d-b3b8-2201ab28f412 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:36.973066 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-73f5d334-8eee-480d-b3b8-2201ab28f412 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:37.140479 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-73f5d334-8eee-480d-b3b8-2201ab28f412 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:37.152122 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-73f5d334-8eee-480d-b3b8-2201ab28f412 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:37.154100 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-73f5d334-8eee-480d-b3b8-2201ab28f412 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:37.155255 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-73f5d334-8eee-480d-b3b8-2201ab28f412 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1809 microversion: 2.20 time: 0.203358 May 19 13:34:37.155804 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 236/454] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:34:36 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1809 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:34:37.727361 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-33d74c61-432d-4c7d-a4b2-f77d9c485da9 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:34:37.728422 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-33d74c61-432d-4c7d-a4b2-f77d9c485da9 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] [instance: c97e472c-540e-4bd5-abaf-d7dadac8c6be] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:34:37.736680 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-33d74c61-432d-4c7d-a4b2-f77d9c485da9 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:37.737111 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-33d74c61-432d-4c7d-a4b2-f77d9c485da9 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:37.737942 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-33d74c61-432d-4c7d-a4b2-f77d9c485da9 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:37.738381 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-33d74c61-432d-4c7d-a4b2-f77d9c485da9 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:37.890561 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-33d74c61-432d-4c7d-a4b2-f77d9c485da9 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11df35c0e4541deaea0494759301a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '510387333865470196f9be30ef62395c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:37.905941 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-33d74c61-432d-4c7d-a4b2-f77d9c485da9 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] 10.222.0.24 "GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be" status: 200 len: 1750 microversion: 2.1 time: 0.180609 May 19 13:34:37.905941 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 219/455] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:34:37 2022] GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be => generated 1750 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:34:38.177644 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-661ba469-73d7-4fbe-ae63-b117a1c4d212 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:34:38.178642 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-661ba469-73d7-4fbe-ae63-b117a1c4d212 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:34:38.190075 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-661ba469-73d7-4fbe-ae63-b117a1c4d212 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:38.190812 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-661ba469-73d7-4fbe-ae63-b117a1c4d212 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:38.192059 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-661ba469-73d7-4fbe-ae63-b117a1c4d212 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:38.192772 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-661ba469-73d7-4fbe-ae63-b117a1c4d212 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:38.339811 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-661ba469-73d7-4fbe-ae63-b117a1c4d212 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:38.350759 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-661ba469-73d7-4fbe-ae63-b117a1c4d212 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:38.352234 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-661ba469-73d7-4fbe-ae63-b117a1c4d212 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:38.353369 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-661ba469-73d7-4fbe-ae63-b117a1c4d212 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1809 microversion: 2.20 time: 0.182312 May 19 13:34:38.353966 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 237/456] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:34:38 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1809 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:34:38.922513 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-fe4d73a8-13a9-4d7b-a3c9-de3c4a21bdc1 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:34:38.923216 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-fe4d73a8-13a9-4d7b-a3c9-de3c4a21bdc1 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] [instance: c97e472c-540e-4bd5-abaf-d7dadac8c6be] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:34:38.925929 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_api:SELECT=36 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:34:38.932590 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-fe4d73a8-13a9-4d7b-a3c9-de3c4a21bdc1 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:38.933113 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-fe4d73a8-13a9-4d7b-a3c9-de3c4a21bdc1 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:38.934121 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-fe4d73a8-13a9-4d7b-a3c9-de3c4a21bdc1 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:38.934830 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-fe4d73a8-13a9-4d7b-a3c9-de3c4a21bdc1 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:39.097265 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-fe4d73a8-13a9-4d7b-a3c9-de3c4a21bdc1 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11df35c0e4541deaea0494759301a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '510387333865470196f9be30ef62395c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:39.105815 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-fe4d73a8-13a9-4d7b-a3c9-de3c4a21bdc1 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] 10.222.0.24 "GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be" status: 200 len: 1750 microversion: 2.1 time: 0.189343 May 19 13:34:39.107146 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 220/457] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:34:38 2022] GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be => generated 1750 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:34:39.374774 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-7011d353-c717-4272-aadf-11b59656de16 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:34:39.375334 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-7011d353-c717-4272-aadf-11b59656de16 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:34:39.382318 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-7011d353-c717-4272-aadf-11b59656de16 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:39.382797 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-7011d353-c717-4272-aadf-11b59656de16 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:39.383533 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-7011d353-c717-4272-aadf-11b59656de16 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:39.383965 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-7011d353-c717-4272-aadf-11b59656de16 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:39.520301 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-7011d353-c717-4272-aadf-11b59656de16 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:39.529941 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-7011d353-c717-4272-aadf-11b59656de16 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:39.531456 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-7011d353-c717-4272-aadf-11b59656de16 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:39.532628 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-7011d353-c717-4272-aadf-11b59656de16 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1809 microversion: 2.20 time: 0.163389 May 19 13:34:39.533180 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 238/458] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:34:39 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:34:40.126630 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-c5b1dd8f-7ac9-4672-81fb-7f093b8b28f2 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:34:40.127419 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-c5b1dd8f-7ac9-4672-81fb-7f093b8b28f2 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] [instance: c97e472c-540e-4bd5-abaf-d7dadac8c6be] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:34:40.134866 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-c5b1dd8f-7ac9-4672-81fb-7f093b8b28f2 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:40.135380 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-c5b1dd8f-7ac9-4672-81fb-7f093b8b28f2 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:40.136247 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-c5b1dd8f-7ac9-4672-81fb-7f093b8b28f2 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:40.136751 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-c5b1dd8f-7ac9-4672-81fb-7f093b8b28f2 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:40.288496 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-c5b1dd8f-7ac9-4672-81fb-7f093b8b28f2 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11df35c0e4541deaea0494759301a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '510387333865470196f9be30ef62395c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:40.297739 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-c5b1dd8f-7ac9-4672-81fb-7f093b8b28f2 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] 10.222.0.24 "GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be" status: 200 len: 1750 microversion: 2.1 time: 0.176397 May 19 13:34:40.298319 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 221/459] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:34:40 2022] GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be => generated 1750 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:34:40.555779 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-40a6a5a1-d0d7-4a13-90aa-5607df474775 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:34:40.556634 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-40a6a5a1-d0d7-4a13-90aa-5607df474775 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:34:40.568211 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-40a6a5a1-d0d7-4a13-90aa-5607df474775 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:40.568962 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-40a6a5a1-d0d7-4a13-90aa-5607df474775 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:40.570281 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-40a6a5a1-d0d7-4a13-90aa-5607df474775 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:40.571000 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-40a6a5a1-d0d7-4a13-90aa-5607df474775 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:40.709099 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-40a6a5a1-d0d7-4a13-90aa-5607df474775 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:40.717804 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-40a6a5a1-d0d7-4a13-90aa-5607df474775 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:40.719273 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-40a6a5a1-d0d7-4a13-90aa-5607df474775 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:40.720415 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-40a6a5a1-d0d7-4a13-90aa-5607df474775 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1809 microversion: 2.20 time: 0.171414 May 19 13:34:40.720974 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 239/460] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:34:40 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:34:41.315187 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-56ad15a3-09dd-453d-98ed-7974e0171d08 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:34:41.315822 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-56ad15a3-09dd-453d-98ed-7974e0171d08 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] [instance: c97e472c-540e-4bd5-abaf-d7dadac8c6be] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:34:41.322715 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-56ad15a3-09dd-453d-98ed-7974e0171d08 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:41.323153 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-56ad15a3-09dd-453d-98ed-7974e0171d08 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:41.323909 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-56ad15a3-09dd-453d-98ed-7974e0171d08 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:41.324330 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-56ad15a3-09dd-453d-98ed-7974e0171d08 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:41.329444 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_cell1:SELECT=100 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:34:41.471123 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-56ad15a3-09dd-453d-98ed-7974e0171d08 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11df35c0e4541deaea0494759301a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '510387333865470196f9be30ef62395c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:41.484182 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-56ad15a3-09dd-453d-98ed-7974e0171d08 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] 10.222.0.24 "GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be" status: 200 len: 1750 microversion: 2.1 time: 0.172871 May 19 13:34:41.484953 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 222/461] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:34:41 2022] GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be => generated 1750 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:34:41.739084 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-00ad67d5-ace9-4d63-8663-79932f035316 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:34:41.739725 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-00ad67d5-ace9-4d63-8663-79932f035316 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:34:41.746832 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-00ad67d5-ace9-4d63-8663-79932f035316 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:41.747274 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-00ad67d5-ace9-4d63-8663-79932f035316 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:41.748315 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-00ad67d5-ace9-4d63-8663-79932f035316 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:41.748746 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-00ad67d5-ace9-4d63-8663-79932f035316 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:41.909520 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-00ad67d5-ace9-4d63-8663-79932f035316 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:41.919791 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-00ad67d5-ace9-4d63-8663-79932f035316 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:41.921779 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-00ad67d5-ace9-4d63-8663-79932f035316 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:41.923688 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-00ad67d5-ace9-4d63-8663-79932f035316 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1809 microversion: 2.20 time: 0.188764 May 19 13:34:41.924253 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 240/462] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:34:41 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1809 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:34:42.502347 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-a7e5108b-3c88-40ca-b295-bcb97877e1ab tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:34:42.502958 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-a7e5108b-3c88-40ca-b295-bcb97877e1ab tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] [instance: c97e472c-540e-4bd5-abaf-d7dadac8c6be] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:34:42.510344 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-a7e5108b-3c88-40ca-b295-bcb97877e1ab tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:42.510792 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-a7e5108b-3c88-40ca-b295-bcb97877e1ab tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:42.511549 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-a7e5108b-3c88-40ca-b295-bcb97877e1ab tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:42.511981 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-a7e5108b-3c88-40ca-b295-bcb97877e1ab tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:42.661207 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-a7e5108b-3c88-40ca-b295-bcb97877e1ab tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11df35c0e4541deaea0494759301a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '510387333865470196f9be30ef62395c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:42.670150 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-a7e5108b-3c88-40ca-b295-bcb97877e1ab tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] 10.222.0.24 "GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be" status: 200 len: 1755 microversion: 2.1 time: 0.171676 May 19 13:34:42.670839 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 223/463] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:34:42 2022] GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be => generated 1755 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:34:42.942647 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-6fa3f3a8-5fc4-4a56-94cf-11151c513495 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:34:42.943230 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-6fa3f3a8-5fc4-4a56-94cf-11151c513495 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:34:42.950440 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-6fa3f3a8-5fc4-4a56-94cf-11151c513495 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:42.951105 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-6fa3f3a8-5fc4-4a56-94cf-11151c513495 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:42.951876 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-6fa3f3a8-5fc4-4a56-94cf-11151c513495 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:42.952316 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-6fa3f3a8-5fc4-4a56-94cf-11151c513495 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:43.093755 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-6fa3f3a8-5fc4-4a56-94cf-11151c513495 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:43.104435 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-6fa3f3a8-5fc4-4a56-94cf-11151c513495 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:43.105977 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-6fa3f3a8-5fc4-4a56-94cf-11151c513495 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:43.107966 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-6fa3f3a8-5fc4-4a56-94cf-11151c513495 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1796 microversion: 2.20 time: 0.169126 May 19 13:34:43.108908 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 241/464] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:34:42 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1796 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:34:43.688718 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-11193795-1b2e-4127-93f3-cba1ad525315 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:34:43.689340 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-11193795-1b2e-4127-93f3-cba1ad525315 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] [instance: c97e472c-540e-4bd5-abaf-d7dadac8c6be] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:34:43.697170 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-11193795-1b2e-4127-93f3-cba1ad525315 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:43.697656 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-11193795-1b2e-4127-93f3-cba1ad525315 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:43.698430 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-11193795-1b2e-4127-93f3-cba1ad525315 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:43.698855 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-11193795-1b2e-4127-93f3-cba1ad525315 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:43.872356 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-11193795-1b2e-4127-93f3-cba1ad525315 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11df35c0e4541deaea0494759301a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '510387333865470196f9be30ef62395c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:43.882503 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-11193795-1b2e-4127-93f3-cba1ad525315 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] 10.222.0.24 "GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be" status: 200 len: 1755 microversion: 2.1 time: 0.197722 May 19 13:34:43.883080 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 224/465] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:34:43 2022] GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be => generated 1755 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:34:44.900431 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-bd374814-5e1d-455d-9c4f-810e9f266356 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:34:44.901007 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-bd374814-5e1d-455d-9c4f-810e9f266356 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] [instance: c97e472c-540e-4bd5-abaf-d7dadac8c6be] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:34:44.908155 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-bd374814-5e1d-455d-9c4f-810e9f266356 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:44.908597 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-bd374814-5e1d-455d-9c4f-810e9f266356 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:44.909523 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-bd374814-5e1d-455d-9c4f-810e9f266356 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:44.910030 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-bd374814-5e1d-455d-9c4f-810e9f266356 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:45.066967 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-bd374814-5e1d-455d-9c4f-810e9f266356 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11df35c0e4541deaea0494759301a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '510387333865470196f9be30ef62395c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:45.079116 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-bd374814-5e1d-455d-9c4f-810e9f266356 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] 10.222.0.24 "GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be" status: 200 len: 1755 microversion: 2.1 time: 0.182576 May 19 13:34:45.079691 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 242/466] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:34:44 2022] GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be => generated 1755 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:34:45.423510 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-eae15ce5-0ad1-42b4-96a0-3a22c0a07963 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:34:45.424008 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-eae15ce5-0ad1-42b4-96a0-3a22c0a07963 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] [instance: 3dc7fd1b-e5d5-4f93-bcff-94b90ed75138] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:34:45.430773 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-eae15ce5-0ad1-42b4-96a0-3a22c0a07963 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:45.431210 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-eae15ce5-0ad1-42b4-96a0-3a22c0a07963 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:45.431958 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-eae15ce5-0ad1-42b4-96a0-3a22c0a07963 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:45.432375 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-eae15ce5-0ad1-42b4-96a0-3a22c0a07963 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:45.572409 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.objects.instance [None req-eae15ce5-0ad1-42b4-96a0-3a22c0a07963 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lazy-loading 'services' on Instance uuid 3dc7fd1b-e5d5-4f93-bcff-94b90ed75138 {{(pid=120472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 13:34:45.696416 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-eae15ce5-0ad1-42b4-96a0-3a22c0a07963 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] 10.222.0.24 "DELETE /compute/v2.1/servers/3dc7fd1b-e5d5-4f93-bcff-94b90ed75138/os-volume_attachments/64187414-1956-4fb7-906a-e2d20858221c" status: 202 len: 0 microversion: 2.1 time: 0.276964 May 19 13:34:45.697017 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 225/467] 10.222.0.24 () {58 vars in 1415 bytes} [Thu May 19 13:34:45 2022] DELETE /compute/v2.1/servers/3dc7fd1b-e5d5-4f93-bcff-94b90ed75138/os-volume_attachments/64187414-1956-4fb7-906a-e2d20858221c => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 13:34:46.099945 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-33867c1c-2247-4d15-95c1-521d702edf20 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:34:46.100742 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-33867c1c-2247-4d15-95c1-521d702edf20 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] [instance: c97e472c-540e-4bd5-abaf-d7dadac8c6be] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:34:46.110940 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-33867c1c-2247-4d15-95c1-521d702edf20 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:46.111615 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-33867c1c-2247-4d15-95c1-521d702edf20 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:46.112769 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-33867c1c-2247-4d15-95c1-521d702edf20 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:46.113452 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-33867c1c-2247-4d15-95c1-521d702edf20 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:46.276763 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-33867c1c-2247-4d15-95c1-521d702edf20 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11df35c0e4541deaea0494759301a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '510387333865470196f9be30ef62395c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:46.285719 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-33867c1c-2247-4d15-95c1-521d702edf20 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] 10.222.0.24 "GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be" status: 200 len: 1755 microversion: 2.1 time: 0.191772 May 19 13:34:46.286552 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 243/468] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:34:46 2022] GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be => generated 1755 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:34:46.817996 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-806928e4-e9c7-42da-bbb0-c6cc5e601149 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:34:46.818544 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-806928e4-e9c7-42da-bbb0-c6cc5e601149 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] [instance: 3dc7fd1b-e5d5-4f93-bcff-94b90ed75138] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:34:46.825807 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-806928e4-e9c7-42da-bbb0-c6cc5e601149 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:46.826253 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-806928e4-e9c7-42da-bbb0-c6cc5e601149 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:46.827050 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-806928e4-e9c7-42da-bbb0-c6cc5e601149 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:46.827471 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-806928e4-e9c7-42da-bbb0-c6cc5e601149 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:46.854668 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-806928e4-e9c7-42da-bbb0-c6cc5e601149 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] [instance: 3dc7fd1b-e5d5-4f93-bcff-94b90ed75138] Going to try to terminate instance {{(pid=120472) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 13:34:46.948383 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-806928e4-e9c7-42da-bbb0-c6cc5e601149 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] 10.222.0.24 "DELETE /compute/v2.1/servers/3dc7fd1b-e5d5-4f93-bcff-94b90ed75138" status: 204 len: 0 microversion: 2.1 time: 0.134407 May 19 13:34:46.948976 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 226/469] 10.222.0.24 () {58 vars in 1238 bytes} [Thu May 19 13:34:46 2022] DELETE /compute/v2.1/servers/3dc7fd1b-e5d5-4f93-bcff-94b90ed75138 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 13:34:46.957434 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-3ea93713-44eb-4726-bf83-5d4c8ffd0986 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:34:46.958085 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-3ea93713-44eb-4726-bf83-5d4c8ffd0986 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] [instance: 3dc7fd1b-e5d5-4f93-bcff-94b90ed75138] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:34:46.964350 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-3ea93713-44eb-4726-bf83-5d4c8ffd0986 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:46.964793 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-3ea93713-44eb-4726-bf83-5d4c8ffd0986 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:46.965579 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-3ea93713-44eb-4726-bf83-5d4c8ffd0986 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:46.966009 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-3ea93713-44eb-4726-bf83-5d4c8ffd0986 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:47.101259 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-3ea93713-44eb-4726-bf83-5d4c8ffd0986 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26c50b54171491b987ca844091c6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96a605108ec47a081c60bc8dc16fd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:47.109724 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-3ea93713-44eb-4726-bf83-5d4c8ffd0986 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] 10.222.0.24 "GET /compute/v2.1/servers/3dc7fd1b-e5d5-4f93-bcff-94b90ed75138" status: 200 len: 1514 microversion: 2.1 time: 0.156226 May 19 13:34:47.110298 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 244/470] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:34:46 2022] GET /compute/v2.1/servers/3dc7fd1b-e5d5-4f93-bcff-94b90ed75138 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:34:47.307895 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-760162d7-0e3b-4217-8d6b-386d3ab983a7 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:34:47.308688 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-760162d7-0e3b-4217-8d6b-386d3ab983a7 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] [instance: c97e472c-540e-4bd5-abaf-d7dadac8c6be] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:34:47.317923 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-760162d7-0e3b-4217-8d6b-386d3ab983a7 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:47.318431 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-760162d7-0e3b-4217-8d6b-386d3ab983a7 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:47.319539 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-760162d7-0e3b-4217-8d6b-386d3ab983a7 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:47.320114 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-760162d7-0e3b-4217-8d6b-386d3ab983a7 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:47.471779 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-760162d7-0e3b-4217-8d6b-386d3ab983a7 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11df35c0e4541deaea0494759301a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '510387333865470196f9be30ef62395c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:47.480293 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-760162d7-0e3b-4217-8d6b-386d3ab983a7 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] 10.222.0.24 "GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be" status: 200 len: 1755 microversion: 2.1 time: 0.179240 May 19 13:34:47.480834 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 227/471] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:34:47 2022] GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be => generated 1755 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:34:48.132627 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-3b29442e-0ff6-4ff5-8d7f-bc7d87fcd782 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:34:48.133509 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-3b29442e-0ff6-4ff5-8d7f-bc7d87fcd782 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] [instance: 3dc7fd1b-e5d5-4f93-bcff-94b90ed75138] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:34:48.142620 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-3b29442e-0ff6-4ff5-8d7f-bc7d87fcd782 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:48.143074 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-3b29442e-0ff6-4ff5-8d7f-bc7d87fcd782 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:48.143837 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-3b29442e-0ff6-4ff5-8d7f-bc7d87fcd782 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:48.144269 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-3b29442e-0ff6-4ff5-8d7f-bc7d87fcd782 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:48.283622 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-3b29442e-0ff6-4ff5-8d7f-bc7d87fcd782 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26c50b54171491b987ca844091c6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96a605108ec47a081c60bc8dc16fd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:48.291174 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-3b29442e-0ff6-4ff5-8d7f-bc7d87fcd782 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] 10.222.0.24 "GET /compute/v2.1/servers/3dc7fd1b-e5d5-4f93-bcff-94b90ed75138" status: 200 len: 1514 microversion: 2.1 time: 0.165376 May 19 13:34:48.291735 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 245/472] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:34:48 2022] GET /compute/v2.1/servers/3dc7fd1b-e5d5-4f93-bcff-94b90ed75138 => generated 1514 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:34:48.500998 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-f4f53199-823e-4f57-9487-b223299938c4 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:34:48.501689 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-f4f53199-823e-4f57-9487-b223299938c4 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] [instance: c97e472c-540e-4bd5-abaf-d7dadac8c6be] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:34:48.509277 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-f4f53199-823e-4f57-9487-b223299938c4 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:48.509799 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-f4f53199-823e-4f57-9487-b223299938c4 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:48.510660 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-f4f53199-823e-4f57-9487-b223299938c4 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:48.511128 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-f4f53199-823e-4f57-9487-b223299938c4 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:48.661269 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-f4f53199-823e-4f57-9487-b223299938c4 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11df35c0e4541deaea0494759301a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '510387333865470196f9be30ef62395c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:48.673390 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-f4f53199-823e-4f57-9487-b223299938c4 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] 10.222.0.24 "GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be" status: 200 len: 1755 microversion: 2.1 time: 0.178012 May 19 13:34:48.674017 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 228/473] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:34:48 2022] GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be => generated 1755 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:34:49.308918 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-a9d1a110-62d5-488d-bd94-f841e69c019d tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:34:49.309569 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-a9d1a110-62d5-488d-bd94-f841e69c019d tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] [instance: 3dc7fd1b-e5d5-4f93-bcff-94b90ed75138] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:34:49.317061 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-a9d1a110-62d5-488d-bd94-f841e69c019d tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:49.317551 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-a9d1a110-62d5-488d-bd94-f841e69c019d tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:49.318317 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-a9d1a110-62d5-488d-bd94-f841e69c019d tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:49.318720 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-a9d1a110-62d5-488d-bd94-f841e69c019d tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:49.692299 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-5830f1d0-0945-4a9b-8e12-e6e761749acb tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:34:49.692963 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-5830f1d0-0945-4a9b-8e12-e6e761749acb tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] [instance: c97e472c-540e-4bd5-abaf-d7dadac8c6be] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:34:49.702096 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-5830f1d0-0945-4a9b-8e12-e6e761749acb tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:49.702533 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-5830f1d0-0945-4a9b-8e12-e6e761749acb tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:49.703470 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-5830f1d0-0945-4a9b-8e12-e6e761749acb tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:49.704330 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-5830f1d0-0945-4a9b-8e12-e6e761749acb tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:49.821986 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-a9d1a110-62d5-488d-bd94-f841e69c019d tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26c50b54171491b987ca844091c6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96a605108ec47a081c60bc8dc16fd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:49.833744 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-a9d1a110-62d5-488d-bd94-f841e69c019d tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] 10.222.0.24 "GET /compute/v2.1/servers/3dc7fd1b-e5d5-4f93-bcff-94b90ed75138" status: 200 len: 1514 microversion: 2.1 time: 0.528602 May 19 13:34:49.834610 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 246/474] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:34:49 2022] GET /compute/v2.1/servers/3dc7fd1b-e5d5-4f93-bcff-94b90ed75138 => generated 1514 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:34:49.860474 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-5830f1d0-0945-4a9b-8e12-e6e761749acb tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11df35c0e4541deaea0494759301a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '510387333865470196f9be30ef62395c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:49.868555 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-5830f1d0-0945-4a9b-8e12-e6e761749acb tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] 10.222.0.24 "GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be" status: 200 len: 1755 microversion: 2.1 time: 0.180948 May 19 13:34:49.869154 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 229/475] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:34:49 2022] GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be => generated 1755 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:34:50.140482 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [req-06d036eb-8e95-4cc0-9dc6-b72af0d0579f req-28a593aa-bf02-42e9-9ab8-98f0fccb4159 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dc7fd1b-e5d5-4f93-bcff-94b90ed75138", "name": "network-vif-deleted", "tag": "e53ff309-b270-4145-8e81-9fc7f9777b9d"}]} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:34:50.149124 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-06d036eb-8e95-4cc0-9dc6-b72af0d0579f req-28a593aa-bf02-42e9-9ab8-98f0fccb4159 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:50.149676 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-06d036eb-8e95-4cc0-9dc6-b72af0d0579f req-28a593aa-bf02-42e9-9ab8-98f0fccb4159 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:50.161864 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.compute.server_external_events [req-06d036eb-8e95-4cc0-9dc6-b72af0d0579f req-28a593aa-bf02-42e9-9ab8-98f0fccb4159 service nova] Creating event network-vif-deleted:e53ff309-b270-4145-8e81-9fc7f9777b9d for instance 3dc7fd1b-e5d5-4f93-bcff-94b90ed75138 on hv-cinder-84112 May 19 13:34:50.166773 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [req-06d036eb-8e95-4cc0-9dc6-b72af0d0579f req-28a593aa-bf02-42e9-9ab8-98f0fccb4159 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030358 May 19 13:34:50.167380 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 247/476] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:34:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:34:50.855066 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-da08daf3-c27c-4838-b77e-290773d49e37 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:34:50.856107 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-da08daf3-c27c-4838-b77e-290773d49e37 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] [instance: 3dc7fd1b-e5d5-4f93-bcff-94b90ed75138] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:34:50.864523 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-da08daf3-c27c-4838-b77e-290773d49e37 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:50.864973 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-da08daf3-c27c-4838-b77e-290773d49e37 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:50.865802 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-da08daf3-c27c-4838-b77e-290773d49e37 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:50.866254 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-da08daf3-c27c-4838-b77e-290773d49e37 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:50.887201 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-c04bcd26-b74b-464d-abfa-ef0a3c5df5f6 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:34:50.887936 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-c04bcd26-b74b-464d-abfa-ef0a3c5df5f6 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] [instance: c97e472c-540e-4bd5-abaf-d7dadac8c6be] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:34:50.894726 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-c04bcd26-b74b-464d-abfa-ef0a3c5df5f6 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:50.895171 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-c04bcd26-b74b-464d-abfa-ef0a3c5df5f6 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:50.895931 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-c04bcd26-b74b-464d-abfa-ef0a3c5df5f6 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:50.896339 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-c04bcd26-b74b-464d-abfa-ef0a3c5df5f6 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:50.900034 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-da08daf3-c27c-4838-b77e-290773d49e37 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:50.900455 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-da08daf3-c27c-4838-b77e-290773d49e37 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:50.901196 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.objects.instance [None req-da08daf3-c27c-4838-b77e-290773d49e37 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lazy-loading 'fault' on Instance uuid 3dc7fd1b-e5d5-4f93-bcff-94b90ed75138 {{(pid=120472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 13:34:50.947843 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-da08daf3-c27c-4838-b77e-290773d49e37 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26c50b54171491b987ca844091c6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96a605108ec47a081c60bc8dc16fd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:50.956420 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-da08daf3-c27c-4838-b77e-290773d49e37 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] 10.222.0.24 "GET /compute/v2.1/servers/3dc7fd1b-e5d5-4f93-bcff-94b90ed75138" status: 200 len: 1309 microversion: 2.1 time: 0.107839 May 19 13:34:50.957204 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 230/477] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:34:50 2022] GET /compute/v2.1/servers/3dc7fd1b-e5d5-4f93-bcff-94b90ed75138 => generated 1309 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:34:51.046764 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-c04bcd26-b74b-464d-abfa-ef0a3c5df5f6 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11df35c0e4541deaea0494759301a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '510387333865470196f9be30ef62395c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:51.055314 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-c04bcd26-b74b-464d-abfa-ef0a3c5df5f6 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] 10.222.0.24 "GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be" status: 200 len: 1755 microversion: 2.1 time: 0.173043 May 19 13:34:51.055899 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 248/478] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:34:50 2022] GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be => generated 1755 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:34:51.974831 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-402125ca-f03f-4975-a384-6a6512db3690 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:34:51.975393 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-402125ca-f03f-4975-a384-6a6512db3690 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] [instance: 3dc7fd1b-e5d5-4f93-bcff-94b90ed75138] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:34:51.982644 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-402125ca-f03f-4975-a384-6a6512db3690 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:51.983083 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-402125ca-f03f-4975-a384-6a6512db3690 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:51.983831 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-402125ca-f03f-4975-a384-6a6512db3690 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:51.984312 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-402125ca-f03f-4975-a384-6a6512db3690 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:52.003047 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.wsgi [None req-402125ca-f03f-4975-a384-6a6512db3690 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] HTTP exception thrown: Instance 3dc7fd1b-e5d5-4f93-bcff-94b90ed75138 could not be found. May 19 13:34:52.004700 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-402125ca-f03f-4975-a384-6a6512db3690 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Request method failure captured: May 19 13:34:52.004700 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: request: GET /compute/v2.1/servers/3dc7fd1b-e5d5-4f93-bcff-94b90ed75138 HTTP/1.1 May 19 13:34:52.004700 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Accept: application/json May 19 13:34:52.004700 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Accept-Encoding: identity May 19 13:34:52.004700 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Connection: close May 19 13:34:52.004700 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Content-Length: 0 May 19 13:34:52.004700 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Content-Type: application/json May 19 13:34:52.004700 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Host: 10.222.0.24 May 19 13:34:52.004700 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Openstack-System-Scope: None May 19 13:34:52.004700 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: User-Agent: python-urllib3/1.26.9 May 19 13:34:52.004700 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Auth-Token: gAAAAABihkciErpGRGTHy_HC9rB31uaIJ1ZcY901_HZKXf-8Zb6lTyuEBcTJQMduhkNA2CJRaXG1Xm3s0YizpoqVto4oCnqG2L99_spROU9YmWHfqURHFtMGfDHMYJpZe63JHkiyz762OrL-uJyC9BluYu8s4IhovxCjhAZjOStieyYBHwZvAeU May 19 13:34:52.004700 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Domain-Id: None May 19 13:34:52.004700 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Domain-Name: None May 19 13:34:52.004700 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Identity-Status: Confirmed May 19 13:34:52.004700 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Is-Admin-Project: True May 19 13:34:52.004700 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Domain-Id: default May 19 13:34:52.004700 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Domain-Name: Default May 19 13:34:52.004700 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Id: c96a605108ec47a081c60bc8dc16fd8e May 19 13:34:52.004700 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Name: tempest-VolumesSnapshotTestJSON-908856571 May 19 13:34:52.004700 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Role: reader,member May 19 13:34:52.004700 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Roles: reader,member May 19 13:34:52.006295 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/c96a605108ec47a081c60bc8dc16fd8e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/c96a605108ec47a081c60bc8dc16fd8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_c96a605108ec47a081c60bc8dc16fd8e", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/c96a605108ec47a081c60bc8dc16fd8e"}]}] May 19 13:34:52.006295 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant: tempest-VolumesSnapshotTestJSON-908856571 May 19 13:34:52.006295 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant-Id: c96a605108ec47a081c60bc8dc16fd8e May 19 13:34:52.006295 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-908856571 May 19 13:34:52.006295 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User: tempest-VolumesSnapshotTestJSON-908856571-project May 19 13:34:52.006295 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Domain-Id: default May 19 13:34:52.006295 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Domain-Name: Default May 19 13:34:52.006295 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Id: d26c50b54171491b987ca844091c6e73 May 19 13:34:52.006295 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Name: tempest-VolumesSnapshotTestJSON-908856571-project May 19 13:34:52.006295 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: method: > May 19 13:34:52.006295 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: exception: Instance 3dc7fd1b-e5d5-4f93-bcff-94b90ed75138 could not be found. May 19 13:34:52.006295 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: action_args: {'id': '3dc7fd1b-e5d5-4f93-bcff-94b90ed75138'} May 19 13:34:52.008096 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:34:52.008096 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:34:52.008096 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 13:34:52.008096 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 13:34:52.008096 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 13:34:52.008096 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 13:34:52.008096 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 13:34:52.008096 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 13:34:52.008096 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 13:34:52.008096 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 13:34:52.008096 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3dc7fd1b-e5d5-4f93-bcff-94b90ed75138 could not be found. May 19 13:34:52.008096 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:34:52.008096 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:34:52.008096 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:34:52.008096 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:34:52.008096 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:34:52.008096 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:34:52.008096 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:34:52.008096 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:34:52.008096 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:34:52.009648 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:34:52.009648 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 13:34:52.009648 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 13:34:52.009648 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 13:34:52.009648 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 13:34:52.009648 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 13:34:52.009648 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 13:34:52.009648 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3dc7fd1b-e5d5-4f93-bcff-94b90ed75138 could not be found. May 19 13:34:52.009648 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:34:52.009648 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:34:52.009648 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:34:52.009648 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:34:52.009648 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:34:52.009648 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:34:52.009648 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:34:52.009648 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:34:52.009648 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3dc7fd1b-e5d5-4f93-bcff-94b90ed75138 could not be found. May 19 13:34:52.009648 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:34:52.010961 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-402125ca-f03f-4975-a384-6a6512db3690 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Returning 404 to user: Instance 3dc7fd1b-e5d5-4f93-bcff-94b90ed75138 could not be found. {{(pid=120472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:34:52.010961 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-402125ca-f03f-4975-a384-6a6512db3690 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] 10.222.0.24 "GET /compute/v2.1/servers/3dc7fd1b-e5d5-4f93-bcff-94b90ed75138" status: 404 len: 111 microversion: 2.1 time: 0.035438 May 19 13:34:52.010961 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 231/479] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:34:51 2022] GET /compute/v2.1/servers/3dc7fd1b-e5d5-4f93-bcff-94b90ed75138 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 13:34:52.073056 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-2f9bdf8e-5ab9-4e9a-a86b-1c0a50e9a15f tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:34:52.073685 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-2f9bdf8e-5ab9-4e9a-a86b-1c0a50e9a15f tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] [instance: c97e472c-540e-4bd5-abaf-d7dadac8c6be] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:34:52.080854 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-2f9bdf8e-5ab9-4e9a-a86b-1c0a50e9a15f tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:52.081298 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-2f9bdf8e-5ab9-4e9a-a86b-1c0a50e9a15f tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:52.082204 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-2f9bdf8e-5ab9-4e9a-a86b-1c0a50e9a15f tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:52.082622 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-2f9bdf8e-5ab9-4e9a-a86b-1c0a50e9a15f tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:52.239584 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-2f9bdf8e-5ab9-4e9a-a86b-1c0a50e9a15f tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11df35c0e4541deaea0494759301a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '510387333865470196f9be30ef62395c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:52.247658 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-2f9bdf8e-5ab9-4e9a-a86b-1c0a50e9a15f tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] 10.222.0.24 "GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be" status: 200 len: 1755 microversion: 2.1 time: 0.178505 May 19 13:34:52.248213 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 249/480] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:34:52 2022] GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be => generated 1755 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:34:53.267209 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-b30ec88f-edb4-420e-b814-df55131fa4a8 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:34:53.267848 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-b30ec88f-edb4-420e-b814-df55131fa4a8 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] [instance: c97e472c-540e-4bd5-abaf-d7dadac8c6be] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:34:53.274875 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-b30ec88f-edb4-420e-b814-df55131fa4a8 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:53.275322 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-b30ec88f-edb4-420e-b814-df55131fa4a8 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:53.276417 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-b30ec88f-edb4-420e-b814-df55131fa4a8 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:53.278452 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-b30ec88f-edb4-420e-b814-df55131fa4a8 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:53.439424 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-b30ec88f-edb4-420e-b814-df55131fa4a8 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11df35c0e4541deaea0494759301a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '510387333865470196f9be30ef62395c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:53.447846 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-b30ec88f-edb4-420e-b814-df55131fa4a8 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] 10.222.0.24 "GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be" status: 200 len: 1755 microversion: 2.1 time: 0.186068 May 19 13:34:53.448423 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 232/481] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:34:53 2022] GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be => generated 1755 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:34:54.469533 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-6cbf080b-cd4c-433e-9642-66203c0cd656 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:34:54.470239 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-6cbf080b-cd4c-433e-9642-66203c0cd656 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] [instance: c97e472c-540e-4bd5-abaf-d7dadac8c6be] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:34:54.473081 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_api:SELECT=45 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:34:54.479321 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-6cbf080b-cd4c-433e-9642-66203c0cd656 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:54.479819 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-6cbf080b-cd4c-433e-9642-66203c0cd656 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:54.480696 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-6cbf080b-cd4c-433e-9642-66203c0cd656 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:54.481172 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-6cbf080b-cd4c-433e-9642-66203c0cd656 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:54.484222 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:34:54.652668 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-6cbf080b-cd4c-433e-9642-66203c0cd656 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11df35c0e4541deaea0494759301a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '510387333865470196f9be30ef62395c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:54.665885 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-6cbf080b-cd4c-433e-9642-66203c0cd656 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] 10.222.0.24 "GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be" status: 200 len: 1755 microversion: 2.1 time: 0.202747 May 19 13:34:54.666655 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 250/482] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:34:54 2022] GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be => generated 1755 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:34:55.684969 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-2f3aa350-c19a-40c8-9b26-3f79471bae62 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:34:55.685586 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-2f3aa350-c19a-40c8-9b26-3f79471bae62 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] [instance: c97e472c-540e-4bd5-abaf-d7dadac8c6be] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:34:55.692572 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-2f3aa350-c19a-40c8-9b26-3f79471bae62 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:55.693027 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-2f3aa350-c19a-40c8-9b26-3f79471bae62 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:55.693840 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-2f3aa350-c19a-40c8-9b26-3f79471bae62 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:55.694274 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-2f3aa350-c19a-40c8-9b26-3f79471bae62 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:55.844924 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-2f3aa350-c19a-40c8-9b26-3f79471bae62 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11df35c0e4541deaea0494759301a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '510387333865470196f9be30ef62395c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:55.852965 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-2f3aa350-c19a-40c8-9b26-3f79471bae62 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] 10.222.0.24 "GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be" status: 200 len: 1755 microversion: 2.1 time: 0.171884 May 19 13:34:55.853545 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 233/483] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:34:55 2022] GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be => generated 1755 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:34:56.873653 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-2b8aa30f-41e2-41af-8157-9c31daff1624 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:34:56.874509 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-2b8aa30f-41e2-41af-8157-9c31daff1624 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] [instance: c97e472c-540e-4bd5-abaf-d7dadac8c6be] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:34:56.885706 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-2b8aa30f-41e2-41af-8157-9c31daff1624 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:56.886481 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-2b8aa30f-41e2-41af-8157-9c31daff1624 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:56.887705 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-2b8aa30f-41e2-41af-8157-9c31daff1624 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:56.888412 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-2b8aa30f-41e2-41af-8157-9c31daff1624 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:57.036068 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-2b8aa30f-41e2-41af-8157-9c31daff1624 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11df35c0e4541deaea0494759301a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '510387333865470196f9be30ef62395c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:57.045028 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-2b8aa30f-41e2-41af-8157-9c31daff1624 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] 10.222.0.24 "GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be" status: 200 len: 1755 microversion: 2.1 time: 0.178136 May 19 13:34:57.045628 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 251/484] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:34:56 2022] GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be => generated 1755 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:34:58.062856 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-29e217b2-6845-4a1a-8005-be343f0f02ea tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:34:58.063476 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-29e217b2-6845-4a1a-8005-be343f0f02ea tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] [instance: c97e472c-540e-4bd5-abaf-d7dadac8c6be] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:34:58.070784 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-29e217b2-6845-4a1a-8005-be343f0f02ea tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:58.071230 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-29e217b2-6845-4a1a-8005-be343f0f02ea tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:58.071998 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-29e217b2-6845-4a1a-8005-be343f0f02ea tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:58.072434 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-29e217b2-6845-4a1a-8005-be343f0f02ea tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:58.220902 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-29e217b2-6845-4a1a-8005-be343f0f02ea tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11df35c0e4541deaea0494759301a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '510387333865470196f9be30ef62395c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:58.232485 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-29e217b2-6845-4a1a-8005-be343f0f02ea tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] 10.222.0.24 "GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be" status: 200 len: 1755 microversion: 2.1 time: 0.173578 May 19 13:34:58.233148 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 234/485] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:34:58 2022] GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be => generated 1755 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:34:59.256322 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-93b86dd7-f9bc-4db1-9b8b-d681d19cc335 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:34:59.257245 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-93b86dd7-f9bc-4db1-9b8b-d681d19cc335 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] [instance: c97e472c-540e-4bd5-abaf-d7dadac8c6be] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:34:59.267701 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-93b86dd7-f9bc-4db1-9b8b-d681d19cc335 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:59.268146 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-93b86dd7-f9bc-4db1-9b8b-d681d19cc335 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:59.268947 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-93b86dd7-f9bc-4db1-9b8b-d681d19cc335 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:34:59.269374 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-93b86dd7-f9bc-4db1-9b8b-d681d19cc335 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:34:59.430713 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-93b86dd7-f9bc-4db1-9b8b-d681d19cc335 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11df35c0e4541deaea0494759301a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '510387333865470196f9be30ef62395c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:34:59.439194 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-93b86dd7-f9bc-4db1-9b8b-d681d19cc335 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] 10.222.0.24 "GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be" status: 200 len: 1755 microversion: 2.1 time: 0.190122 May 19 13:34:59.439766 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 252/486] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:34:59 2022] GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be => generated 1755 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:34:59.894826 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-8c247bc2-85d7-4fb3-821c-612fbd59aa62 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-80106694", "imageRef": "9beb860d-9c3f-4244-80aa-71a9c337a429", "flavorRef": "452", "networks": [{"uuid": "87bf18b1-62e1-4c33-ac80-cb8609461a97"}]}} {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:34:59.949763 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.network.neutron [None req-8c247bc2-85d7-4fb3-821c-612fbd59aa62 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] validate_networks() for [('87bf18b1-62e1-4c33-ac80-cb8609461a97', None, None, None, None, None)] {{(pid=120472) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 13:35:00.301971 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.virt.hardware [None req-8c247bc2-85d7-4fb3-821c-612fbd59aa62 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Flavor limits 0:0:0 {{(pid=120472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 13:35:00.302568 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.virt.hardware [None req-8c247bc2-85d7-4fb3-821c-612fbd59aa62 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Image limits 0:0:0 {{(pid=120472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 13:35:00.303299 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.virt.hardware [None req-8c247bc2-85d7-4fb3-821c-612fbd59aa62 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Flavor pref 0:0:0 {{(pid=120472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 13:35:00.303890 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.virt.hardware [None req-8c247bc2-85d7-4fb3-821c-612fbd59aa62 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Image pref 0:0:0 {{(pid=120472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 13:35:00.304625 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.virt.hardware [None req-8c247bc2-85d7-4fb3-821c-612fbd59aa62 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 13:35:00.317032 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-8c247bc2-85d7-4fb3-821c-612fbd59aa62 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:00.317448 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-8c247bc2-85d7-4fb3-821c-612fbd59aa62 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:00.318265 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-8c247bc2-85d7-4fb3-821c-612fbd59aa62 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:00.318698 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-8c247bc2-85d7-4fb3-821c-612fbd59aa62 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:00.335743 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.quota [None req-8c247bc2-85d7-4fb3-821c-612fbd59aa62 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Getting quotas for project c96a605108ec47a081c60bc8dc16fd8e. Resources: {'instances', 'cores', 'ram'} {{(pid=120472) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 13:35:00.339870 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.quota [None req-8c247bc2-85d7-4fb3-821c-612fbd59aa62 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Getting quotas for user d26c50b54171491b987ca844091c6e73 and project c96a605108ec47a081c60bc8dc16fd8e. Resources: {'instances', 'cores', 'ram'} {{(pid=120472) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 13:35:00.351120 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-8c247bc2-85d7-4fb3-821c-612fbd59aa62 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Going to run 1 instances... {{(pid=120472) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 13:35:00.353362 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-8c247bc2-85d7-4fb3-821c-612fbd59aa62 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] [instance: 7c295eb7-8e9f-436b-8e36-05adc8fbfcf4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9beb860d-9c3f-4244-80aa-71a9c337a429',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120472) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 13:35:00.405392 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-8c247bc2-85d7-4fb3-821c-612fbd59aa62 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.514371 May 19 13:35:00.406158 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 235/487] 10.222.0.24 () {60 vars in 1146 bytes} [Thu May 19 13:34:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 516 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 13:35:00.416126 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-419d2a36-9ec0-416e-8996-03c5529f1dd9 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:00.416738 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-419d2a36-9ec0-416e-8996-03c5529f1dd9 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] [instance: 7c295eb7-8e9f-436b-8e36-05adc8fbfcf4] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:00.456365 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-55ff315b-bc8e-483a-9aa1-d58b96f18dfc tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:00.456968 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-55ff315b-bc8e-483a-9aa1-d58b96f18dfc tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] [instance: c97e472c-540e-4bd5-abaf-d7dadac8c6be] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:00.463478 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-55ff315b-bc8e-483a-9aa1-d58b96f18dfc tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:00.463910 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-55ff315b-bc8e-483a-9aa1-d58b96f18dfc tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:00.464669 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-55ff315b-bc8e-483a-9aa1-d58b96f18dfc tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:00.465096 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-55ff315b-bc8e-483a-9aa1-d58b96f18dfc tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:00.476525 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-419d2a36-9ec0-416e-8996-03c5529f1dd9 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26c50b54171491b987ca844091c6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96a605108ec47a081c60bc8dc16fd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:00.485026 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-419d2a36-9ec0-416e-8996-03c5529f1dd9 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] 10.222.0.24 "GET /compute/v2.1/servers/7c295eb7-8e9f-436b-8e36-05adc8fbfcf4" status: 200 len: 1217 microversion: 2.1 time: 0.072687 May 19 13:35:00.486168 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 253/488] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:35:00 2022] GET /compute/v2.1/servers/7c295eb7-8e9f-436b-8e36-05adc8fbfcf4 => generated 1217 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:35:00.618777 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-55ff315b-bc8e-483a-9aa1-d58b96f18dfc tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11df35c0e4541deaea0494759301a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '510387333865470196f9be30ef62395c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:00.630633 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-55ff315b-bc8e-483a-9aa1-d58b96f18dfc tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] 10.222.0.24 "GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be" status: 200 len: 1758 microversion: 2.1 time: 0.178339 May 19 13:35:00.631379 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 236/489] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:35:00 2022] GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be => generated 1758 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:35:01.502979 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-6536a9ae-feb6-487c-8348-f51f0eedb8de tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:01.503857 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-6536a9ae-feb6-487c-8348-f51f0eedb8de tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] [instance: 7c295eb7-8e9f-436b-8e36-05adc8fbfcf4] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:01.512075 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-6536a9ae-feb6-487c-8348-f51f0eedb8de tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:01.512540 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-6536a9ae-feb6-487c-8348-f51f0eedb8de tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:01.513311 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-6536a9ae-feb6-487c-8348-f51f0eedb8de tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:01.513837 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-6536a9ae-feb6-487c-8348-f51f0eedb8de tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:01.595662 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-6536a9ae-feb6-487c-8348-f51f0eedb8de tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26c50b54171491b987ca844091c6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96a605108ec47a081c60bc8dc16fd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:01.603758 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-6536a9ae-feb6-487c-8348-f51f0eedb8de tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] 10.222.0.24 "GET /compute/v2.1/servers/7c295eb7-8e9f-436b-8e36-05adc8fbfcf4" status: 200 len: 1277 microversion: 2.1 time: 0.104810 May 19 13:35:01.604330 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 254/490] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:35:01 2022] GET /compute/v2.1/servers/7c295eb7-8e9f-436b-8e36-05adc8fbfcf4 => generated 1277 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:35:02.048906 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-95211b3e-c927-4312-9c95-4964c060aed0 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1fd6b6b4-1ff0-45c4-a900-1a2bfa30a3d4"}} {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:35:02.050064 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-95211b3e-c927-4312-9c95-4964c060aed0 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: 8a3b02c0-6943-45dc-9086-16ff29536118] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:02.056386 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-95211b3e-c927-4312-9c95-4964c060aed0 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:02.056825 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-95211b3e-c927-4312-9c95-4964c060aed0 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:02.057633 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-95211b3e-c927-4312-9c95-4964c060aed0 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:02.058053 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-95211b3e-c927-4312-9c95-4964c060aed0 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:02.073296 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:35:02.340507 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-95211b3e-c927-4312-9c95-4964c060aed0 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "POST /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.295942 May 19 13:35:02.341483 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 237/491] 10.222.0.24 () {60 vars in 1322 bytes} [Thu May 19 13:35:02 2022] POST /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118/os-volume_attachments => generated 194 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:35:02.621444 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-36773155-2180-4824-8ed6-111e79ff495b tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:02.622168 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-36773155-2180-4824-8ed6-111e79ff495b tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] [instance: 7c295eb7-8e9f-436b-8e36-05adc8fbfcf4] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:02.630149 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-36773155-2180-4824-8ed6-111e79ff495b tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:02.630680 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-36773155-2180-4824-8ed6-111e79ff495b tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:02.631439 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-36773155-2180-4824-8ed6-111e79ff495b tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:02.631867 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-36773155-2180-4824-8ed6-111e79ff495b tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:02.853808 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-36773155-2180-4824-8ed6-111e79ff495b tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26c50b54171491b987ca844091c6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96a605108ec47a081c60bc8dc16fd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:02.861484 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-36773155-2180-4824-8ed6-111e79ff495b tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] 10.222.0.24 "GET /compute/v2.1/servers/7c295eb7-8e9f-436b-8e36-05adc8fbfcf4" status: 200 len: 1317 microversion: 2.1 time: 0.244014 May 19 13:35:02.862081 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 255/492] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:35:02 2022] GET /compute/v2.1/servers/7c295eb7-8e9f-436b-8e36-05adc8fbfcf4 => generated 1317 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:35:02.996169 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [req-041bda32-25fc-45ea-ad7a-da6b70788955 req-7a57b886-1901-4617-9ec5-7bf3474b03c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c295eb7-8e9f-436b-8e36-05adc8fbfcf4", "tag": "7edb5a95-96ac-49b8-96a4-f12c01ce4e38"}]} {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:35:03.005900 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [req-041bda32-25fc-45ea-ad7a-da6b70788955 req-7a57b886-1901-4617-9ec5-7bf3474b03c7 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:03.006631 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [req-041bda32-25fc-45ea-ad7a-da6b70788955 req-7a57b886-1901-4617-9ec5-7bf3474b03c7 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:03.018919 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.compute.server_external_events [req-041bda32-25fc-45ea-ad7a-da6b70788955 req-7a57b886-1901-4617-9ec5-7bf3474b03c7 service nova] Creating event network-changed:7edb5a95-96ac-49b8-96a4-f12c01ce4e38 for instance 7c295eb7-8e9f-436b-8e36-05adc8fbfcf4 on hv-cinder-84112 May 19 13:35:03.024200 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [req-041bda32-25fc-45ea-ad7a-da6b70788955 req-7a57b886-1901-4617-9ec5-7bf3474b03c7 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032705 May 19 13:35:03.024870 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 238/493] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:35:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 13:35:03.883775 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-806cb957-beb0-49d0-8ae6-5ebf51e4a900 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:03.884554 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-806cb957-beb0-49d0-8ae6-5ebf51e4a900 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] [instance: 7c295eb7-8e9f-436b-8e36-05adc8fbfcf4] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:03.893660 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-806cb957-beb0-49d0-8ae6-5ebf51e4a900 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:03.894100 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-806cb957-beb0-49d0-8ae6-5ebf51e4a900 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:03.894845 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-806cb957-beb0-49d0-8ae6-5ebf51e4a900 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:03.895271 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-806cb957-beb0-49d0-8ae6-5ebf51e4a900 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:04.029171 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-806cb957-beb0-49d0-8ae6-5ebf51e4a900 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26c50b54171491b987ca844091c6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96a605108ec47a081c60bc8dc16fd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:04.037171 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-806cb957-beb0-49d0-8ae6-5ebf51e4a900 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] 10.222.0.24 "GET /compute/v2.1/servers/7c295eb7-8e9f-436b-8e36-05adc8fbfcf4" status: 200 len: 1317 microversion: 2.1 time: 0.159583 May 19 13:35:04.037779 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 256/494] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:35:03 2022] GET /compute/v2.1/servers/7c295eb7-8e9f-436b-8e36-05adc8fbfcf4 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:35:05.061294 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-af57171f-ee53-46e8-b678-4e29476a0f91 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:05.062513 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-af57171f-ee53-46e8-b678-4e29476a0f91 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] [instance: 7c295eb7-8e9f-436b-8e36-05adc8fbfcf4] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:05.073382 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-af57171f-ee53-46e8-b678-4e29476a0f91 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:05.074172 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-af57171f-ee53-46e8-b678-4e29476a0f91 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:05.075423 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-af57171f-ee53-46e8-b678-4e29476a0f91 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:05.076139 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-af57171f-ee53-46e8-b678-4e29476a0f91 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:05.224905 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-af57171f-ee53-46e8-b678-4e29476a0f91 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26c50b54171491b987ca844091c6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96a605108ec47a081c60bc8dc16fd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:05.233182 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-af57171f-ee53-46e8-b678-4e29476a0f91 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] 10.222.0.24 "GET /compute/v2.1/servers/7c295eb7-8e9f-436b-8e36-05adc8fbfcf4" status: 200 len: 1317 microversion: 2.1 time: 0.179912 May 19 13:35:05.233799 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 239/495] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:35:05 2022] GET /compute/v2.1/servers/7c295eb7-8e9f-436b-8e36-05adc8fbfcf4 => generated 1317 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:35:06.253116 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-d506d491-9c05-49c3-9173-2e297b65e53f tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:06.253716 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-d506d491-9c05-49c3-9173-2e297b65e53f tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] [instance: 7c295eb7-8e9f-436b-8e36-05adc8fbfcf4] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:06.260850 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-d506d491-9c05-49c3-9173-2e297b65e53f tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:06.261301 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-d506d491-9c05-49c3-9173-2e297b65e53f tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:06.262105 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-d506d491-9c05-49c3-9173-2e297b65e53f tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:06.262748 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-d506d491-9c05-49c3-9173-2e297b65e53f tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:06.397627 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-d506d491-9c05-49c3-9173-2e297b65e53f tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26c50b54171491b987ca844091c6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96a605108ec47a081c60bc8dc16fd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:06.405718 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-d506d491-9c05-49c3-9173-2e297b65e53f tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] 10.222.0.24 "GET /compute/v2.1/servers/7c295eb7-8e9f-436b-8e36-05adc8fbfcf4" status: 200 len: 1317 microversion: 2.1 time: 0.157684 May 19 13:35:06.406427 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 257/496] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:35:06 2022] GET /compute/v2.1/servers/7c295eb7-8e9f-436b-8e36-05adc8fbfcf4 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:35:07.423803 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-46eb4b62-f49e-4647-9435-b8587ba04bf9 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:07.424393 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-46eb4b62-f49e-4647-9435-b8587ba04bf9 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] [instance: 7c295eb7-8e9f-436b-8e36-05adc8fbfcf4] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:07.431442 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-46eb4b62-f49e-4647-9435-b8587ba04bf9 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:07.431884 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-46eb4b62-f49e-4647-9435-b8587ba04bf9 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:07.432744 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-46eb4b62-f49e-4647-9435-b8587ba04bf9 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:07.433165 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-46eb4b62-f49e-4647-9435-b8587ba04bf9 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:07.567664 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-46eb4b62-f49e-4647-9435-b8587ba04bf9 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26c50b54171491b987ca844091c6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96a605108ec47a081c60bc8dc16fd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:07.575430 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-46eb4b62-f49e-4647-9435-b8587ba04bf9 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] 10.222.0.24 "GET /compute/v2.1/servers/7c295eb7-8e9f-436b-8e36-05adc8fbfcf4" status: 200 len: 1317 microversion: 2.1 time: 0.155646 May 19 13:35:07.575975 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 240/497] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:35:07 2022] GET /compute/v2.1/servers/7c295eb7-8e9f-436b-8e36-05adc8fbfcf4 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:35:08.596461 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-38d604bf-4ed3-497b-b138-5102da513230 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:08.597038 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-38d604bf-4ed3-497b-b138-5102da513230 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] [instance: 7c295eb7-8e9f-436b-8e36-05adc8fbfcf4] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:08.603912 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-38d604bf-4ed3-497b-b138-5102da513230 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:08.604361 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-38d604bf-4ed3-497b-b138-5102da513230 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:08.605227 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-38d604bf-4ed3-497b-b138-5102da513230 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:08.605690 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-38d604bf-4ed3-497b-b138-5102da513230 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:08.747001 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-38d604bf-4ed3-497b-b138-5102da513230 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26c50b54171491b987ca844091c6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96a605108ec47a081c60bc8dc16fd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:08.754881 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-38d604bf-4ed3-497b-b138-5102da513230 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] 10.222.0.24 "GET /compute/v2.1/servers/7c295eb7-8e9f-436b-8e36-05adc8fbfcf4" status: 200 len: 1317 microversion: 2.1 time: 0.164492 May 19 13:35:08.755453 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 258/498] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:35:08 2022] GET /compute/v2.1/servers/7c295eb7-8e9f-436b-8e36-05adc8fbfcf4 => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:35:09.238147 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [req-8f40fcbb-39d9-47a3-8d0f-d87a897e2e0a req-49f407c3-9113-424b-bef0-010622bf5f44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c295eb7-8e9f-436b-8e36-05adc8fbfcf4", "name": "network-vif-plugged", "status": "completed", "tag": "7edb5a95-96ac-49b8-96a4-f12c01ce4e38"}]} {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:35:09.245514 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:35:09.247529 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [req-8f40fcbb-39d9-47a3-8d0f-d87a897e2e0a req-49f407c3-9113-424b-bef0-010622bf5f44 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:09.247949 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [req-8f40fcbb-39d9-47a3-8d0f-d87a897e2e0a req-49f407c3-9113-424b-bef0-010622bf5f44 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:09.260398 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.compute.server_external_events [req-8f40fcbb-39d9-47a3-8d0f-d87a897e2e0a req-49f407c3-9113-424b-bef0-010622bf5f44 service nova] Creating event network-vif-plugged:7edb5a95-96ac-49b8-96a4-f12c01ce4e38 for instance 7c295eb7-8e9f-436b-8e36-05adc8fbfcf4 on hv-cinder-84112 May 19 13:35:09.265633 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [req-8f40fcbb-39d9-47a3-8d0f-d87a897e2e0a req-49f407c3-9113-424b-bef0-010622bf5f44 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031017 May 19 13:35:09.266543 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 241/499] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:35:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:35:09.776709 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-92d982b8-ae57-435d-b151-1cfaf8bb7a58 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:09.777607 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-92d982b8-ae57-435d-b151-1cfaf8bb7a58 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] [instance: 7c295eb7-8e9f-436b-8e36-05adc8fbfcf4] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:09.788983 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-92d982b8-ae57-435d-b151-1cfaf8bb7a58 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:09.789823 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-92d982b8-ae57-435d-b151-1cfaf8bb7a58 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:09.791068 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-92d982b8-ae57-435d-b151-1cfaf8bb7a58 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:09.791783 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-92d982b8-ae57-435d-b151-1cfaf8bb7a58 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:09.899032 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-430807c1-0f9b-426f-b3bb-820b1a63e36e tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:35:09.900062 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-430807c1-0f9b-426f-b3bb-820b1a63e36e tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: 8a3b02c0-6943-45dc-9086-16ff29536118] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:09.906395 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-430807c1-0f9b-426f-b3bb-820b1a63e36e tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:09.906865 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-430807c1-0f9b-426f-b3bb-820b1a63e36e tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:09.907621 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-430807c1-0f9b-426f-b3bb-820b1a63e36e tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:09.908043 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-430807c1-0f9b-426f-b3bb-820b1a63e36e tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:09.931090 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.objects.instance [None req-430807c1-0f9b-426f-b3bb-820b1a63e36e tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lazy-loading 'flavor' on Instance uuid 8a3b02c0-6943-45dc-9086-16ff29536118 {{(pid=120472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 13:35:09.931282 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-92d982b8-ae57-435d-b151-1cfaf8bb7a58 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26c50b54171491b987ca844091c6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96a605108ec47a081c60bc8dc16fd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:09.940010 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-92d982b8-ae57-435d-b151-1cfaf8bb7a58 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] 10.222.0.24 "GET /compute/v2.1/servers/7c295eb7-8e9f-436b-8e36-05adc8fbfcf4" status: 200 len: 1317 microversion: 2.1 time: 0.169808 May 19 13:35:09.940637 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 259/500] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:35:09 2022] GET /compute/v2.1/servers/7c295eb7-8e9f-436b-8e36-05adc8fbfcf4 => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:35:10.060937 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-430807c1-0f9b-426f-b3bb-820b1a63e36e tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "POST /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118/action" status: 200 len: 32 microversion: 2.1 time: 0.166677 May 19 13:35:10.061475 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 242/501] 10.222.0.24 () {60 vars in 1277 bytes} [Thu May 19 13:35:09 2022] POST /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118/action => generated 32 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 13:35:10.071076 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-546a2c57-28f5-4d7a-b1e4-faf31be0b9bf tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:10.071699 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-546a2c57-28f5-4d7a-b1e4-faf31be0b9bf tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: 8a3b02c0-6943-45dc-9086-16ff29536118] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:10.078156 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-546a2c57-28f5-4d7a-b1e4-faf31be0b9bf tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:10.078737 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-546a2c57-28f5-4d7a-b1e4-faf31be0b9bf tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:10.079640 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-546a2c57-28f5-4d7a-b1e4-faf31be0b9bf tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:10.080075 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-546a2c57-28f5-4d7a-b1e4-faf31be0b9bf tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:10.210786 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-546a2c57-28f5-4d7a-b1e4-faf31be0b9bf tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:10.219289 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-546a2c57-28f5-4d7a-b1e4-faf31be0b9bf tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118" status: 200 len: 1733 microversion: 2.1 time: 0.152194 May 19 13:35:10.219858 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 260/502] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:35:10 2022] GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118 => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:35:10.955439 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_cell0:SELECT=2 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:35:10.956281 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_cell0:SELECT=6 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:35:10.960604 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-68dfd648-191d-4446-ae77-7554011958a6 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:10.961289 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-68dfd648-191d-4446-ae77-7554011958a6 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] [instance: 7c295eb7-8e9f-436b-8e36-05adc8fbfcf4] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:10.968845 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-68dfd648-191d-4446-ae77-7554011958a6 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:10.969285 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-68dfd648-191d-4446-ae77-7554011958a6 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:10.970067 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-68dfd648-191d-4446-ae77-7554011958a6 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:10.970485 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-68dfd648-191d-4446-ae77-7554011958a6 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:11.112696 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-68dfd648-191d-4446-ae77-7554011958a6 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26c50b54171491b987ca844091c6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96a605108ec47a081c60bc8dc16fd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:11.120703 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-68dfd648-191d-4446-ae77-7554011958a6 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] 10.222.0.24 "GET /compute/v2.1/servers/7c295eb7-8e9f-436b-8e36-05adc8fbfcf4" status: 200 len: 1317 microversion: 2.1 time: 0.166778 May 19 13:35:11.121282 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 243/503] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:35:10 2022] GET /compute/v2.1/servers/7c295eb7-8e9f-436b-8e36-05adc8fbfcf4 => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:35:11.243148 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-d1daff25-7791-478d-8d94-9f1f38da0820 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:11.243148 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-d1daff25-7791-478d-8d94-9f1f38da0820 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: 8a3b02c0-6943-45dc-9086-16ff29536118] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:11.245701 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_cell0:SELECT=2 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:35:11.248238 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-d1daff25-7791-478d-8d94-9f1f38da0820 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:11.248713 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-d1daff25-7791-478d-8d94-9f1f38da0820 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:11.249483 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-d1daff25-7791-478d-8d94-9f1f38da0820 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:11.249928 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-d1daff25-7791-478d-8d94-9f1f38da0820 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:11.489088 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-d1daff25-7791-478d-8d94-9f1f38da0820 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:11.497888 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-d1daff25-7791-478d-8d94-9f1f38da0820 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118" status: 200 len: 1733 microversion: 2.1 time: 0.263998 May 19 13:35:11.498384 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 261/504] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:35:11 2022] GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118 => generated 1733 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:35:12.139467 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-a5aef3f1-568f-4223-a304-d4a54bcba2b9 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:12.140092 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-a5aef3f1-568f-4223-a304-d4a54bcba2b9 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] [instance: 7c295eb7-8e9f-436b-8e36-05adc8fbfcf4] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:12.147591 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-a5aef3f1-568f-4223-a304-d4a54bcba2b9 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:12.148034 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-a5aef3f1-568f-4223-a304-d4a54bcba2b9 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:12.148852 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-a5aef3f1-568f-4223-a304-d4a54bcba2b9 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:12.149277 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-a5aef3f1-568f-4223-a304-d4a54bcba2b9 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:12.290112 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-a5aef3f1-568f-4223-a304-d4a54bcba2b9 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26c50b54171491b987ca844091c6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96a605108ec47a081c60bc8dc16fd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:12.298563 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-a5aef3f1-568f-4223-a304-d4a54bcba2b9 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] 10.222.0.24 "GET /compute/v2.1/servers/7c295eb7-8e9f-436b-8e36-05adc8fbfcf4" status: 200 len: 1505 microversion: 2.1 time: 0.163398 May 19 13:35:12.299128 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 244/505] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:35:12 2022] GET /compute/v2.1/servers/7c295eb7-8e9f-436b-8e36-05adc8fbfcf4 => generated 1505 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:35:12.315183 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-edf44b73-3dd5-4c8e-9f2b-86a6008b7583 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "efd6a762-e5a9-4fb2-bdbe-ef098c94d1f3", "device": "/dev/sdb"}} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:35:12.316328 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-edf44b73-3dd5-4c8e-9f2b-86a6008b7583 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] [instance: 7c295eb7-8e9f-436b-8e36-05adc8fbfcf4] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:12.323464 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-edf44b73-3dd5-4c8e-9f2b-86a6008b7583 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:12.323870 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-edf44b73-3dd5-4c8e-9f2b-86a6008b7583 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:12.324657 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-edf44b73-3dd5-4c8e-9f2b-86a6008b7583 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:12.325085 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-edf44b73-3dd5-4c8e-9f2b-86a6008b7583 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:12.514133 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-92bb6783-ebf5-436b-859a-461e1bee69ff tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:12.514738 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-92bb6783-ebf5-436b-859a-461e1bee69ff tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: 8a3b02c0-6943-45dc-9086-16ff29536118] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:12.521315 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-92bb6783-ebf5-436b-859a-461e1bee69ff tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:12.521594 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-92bb6783-ebf5-436b-859a-461e1bee69ff tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:12.522339 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-92bb6783-ebf5-436b-859a-461e1bee69ff tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:12.522768 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-92bb6783-ebf5-436b-859a-461e1bee69ff tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:12.592755 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-edf44b73-3dd5-4c8e-9f2b-86a6008b7583 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] 10.222.0.24 "POST /compute/v2.1/servers/7c295eb7-8e9f-436b-8e36-05adc8fbfcf4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.281523 May 19 13:35:12.593429 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 262/506] 10.222.0.24 () {60 vars in 1322 bytes} [Thu May 19 13:35:12 2022] POST /compute/v2.1/servers/7c295eb7-8e9f-436b-8e36-05adc8fbfcf4/os-volume_attachments => generated 194 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:35:12.664294 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-92bb6783-ebf5-436b-859a-461e1bee69ff tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:12.672496 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-92bb6783-ebf5-436b-859a-461e1bee69ff tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118" status: 200 len: 1733 microversion: 2.1 time: 0.162188 May 19 13:35:12.682111 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 245/507] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:35:12 2022] GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118 => generated 1733 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:35:13.690405 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-0b41727a-bdf9-4951-86e3-a3a1f11e768e tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:13.691055 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-0b41727a-bdf9-4951-86e3-a3a1f11e768e tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: 8a3b02c0-6943-45dc-9086-16ff29536118] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:13.698220 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-0b41727a-bdf9-4951-86e3-a3a1f11e768e tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:13.698665 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-0b41727a-bdf9-4951-86e3-a3a1f11e768e tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:13.699425 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-0b41727a-bdf9-4951-86e3-a3a1f11e768e tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:13.699860 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-0b41727a-bdf9-4951-86e3-a3a1f11e768e tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:13.840172 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-0b41727a-bdf9-4951-86e3-a3a1f11e768e tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:13.848899 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-0b41727a-bdf9-4951-86e3-a3a1f11e768e tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118" status: 200 len: 1733 microversion: 2.1 time: 0.162743 May 19 13:35:13.849820 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 263/508] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:35:13 2022] GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118 => generated 1733 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:35:14.874814 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-ec587fc9-f045-4b18-b804-458f4fcf941d tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:14.875796 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-ec587fc9-f045-4b18-b804-458f4fcf941d tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: 8a3b02c0-6943-45dc-9086-16ff29536118] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:14.883855 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-ec587fc9-f045-4b18-b804-458f4fcf941d tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:14.884295 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-ec587fc9-f045-4b18-b804-458f4fcf941d tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:14.885034 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-ec587fc9-f045-4b18-b804-458f4fcf941d tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:14.885461 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-ec587fc9-f045-4b18-b804-458f4fcf941d tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:15.025250 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-ec587fc9-f045-4b18-b804-458f4fcf941d tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:15.036521 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-ec587fc9-f045-4b18-b804-458f4fcf941d tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118" status: 200 len: 1733 microversion: 2.1 time: 0.168163 May 19 13:35:15.037087 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 246/509] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:35:14 2022] GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118 => generated 1733 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:35:16.056627 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-099663ab-6460-4d02-a95c-9c1297174a66 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:16.057310 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-099663ab-6460-4d02-a95c-9c1297174a66 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: 8a3b02c0-6943-45dc-9086-16ff29536118] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:16.065591 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-099663ab-6460-4d02-a95c-9c1297174a66 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:16.066123 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-099663ab-6460-4d02-a95c-9c1297174a66 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:16.067144 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-099663ab-6460-4d02-a95c-9c1297174a66 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:16.068109 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-099663ab-6460-4d02-a95c-9c1297174a66 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:16.214313 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-099663ab-6460-4d02-a95c-9c1297174a66 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:16.224670 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-099663ab-6460-4d02-a95c-9c1297174a66 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118" status: 200 len: 1733 microversion: 2.1 time: 0.173441 May 19 13:35:16.225236 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 264/510] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:35:16 2022] GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118 => generated 1733 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:35:17.246455 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-86761543-a9d1-4577-a3f2-d7339e653ad9 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:17.247122 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-86761543-a9d1-4577-a3f2-d7339e653ad9 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: 8a3b02c0-6943-45dc-9086-16ff29536118] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:17.254286 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-86761543-a9d1-4577-a3f2-d7339e653ad9 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:17.254796 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-86761543-a9d1-4577-a3f2-d7339e653ad9 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:17.255549 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-86761543-a9d1-4577-a3f2-d7339e653ad9 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:17.255979 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-86761543-a9d1-4577-a3f2-d7339e653ad9 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:17.388443 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-86761543-a9d1-4577-a3f2-d7339e653ad9 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:17.396665 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-86761543-a9d1-4577-a3f2-d7339e653ad9 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118" status: 200 len: 1733 microversion: 2.1 time: 0.154117 May 19 13:35:17.397224 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 247/511] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:35:17 2022] GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118 => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:35:18.418062 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-f38f937c-5d33-4269-88dd-c0c1093cf406 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:18.419484 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-f38f937c-5d33-4269-88dd-c0c1093cf406 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: 8a3b02c0-6943-45dc-9086-16ff29536118] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:18.429283 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-f38f937c-5d33-4269-88dd-c0c1093cf406 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:18.429763 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-f38f937c-5d33-4269-88dd-c0c1093cf406 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:18.430550 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-f38f937c-5d33-4269-88dd-c0c1093cf406 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:18.430973 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-f38f937c-5d33-4269-88dd-c0c1093cf406 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:18.580484 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-f38f937c-5d33-4269-88dd-c0c1093cf406 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:18.589561 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-f38f937c-5d33-4269-88dd-c0c1093cf406 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118" status: 200 len: 1733 microversion: 2.1 time: 0.178037 May 19 13:35:18.590177 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 265/512] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:35:18 2022] GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118 => generated 1733 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:35:19.607423 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-9de3d0fd-ba17-400e-91e4-83439646c3ac tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:19.608020 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-9de3d0fd-ba17-400e-91e4-83439646c3ac tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: 8a3b02c0-6943-45dc-9086-16ff29536118] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:19.615087 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-9de3d0fd-ba17-400e-91e4-83439646c3ac tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:19.615542 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-9de3d0fd-ba17-400e-91e4-83439646c3ac tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:19.616431 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-9de3d0fd-ba17-400e-91e4-83439646c3ac tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:19.616859 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-9de3d0fd-ba17-400e-91e4-83439646c3ac tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:19.763925 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-9de3d0fd-ba17-400e-91e4-83439646c3ac tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:19.774093 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-9de3d0fd-ba17-400e-91e4-83439646c3ac tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118" status: 200 len: 1733 microversion: 2.1 time: 0.170627 May 19 13:35:19.774900 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 248/513] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:35:19 2022] GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118 => generated 1733 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:35:20.797835 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-41f80aca-1881-4de1-a79d-dc5f0de0572c tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:20.798874 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-41f80aca-1881-4de1-a79d-dc5f0de0572c tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: 8a3b02c0-6943-45dc-9086-16ff29536118] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:20.810665 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-41f80aca-1881-4de1-a79d-dc5f0de0572c tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:20.811422 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-41f80aca-1881-4de1-a79d-dc5f0de0572c tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:20.812678 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-41f80aca-1881-4de1-a79d-dc5f0de0572c tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:20.813390 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-41f80aca-1881-4de1-a79d-dc5f0de0572c tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:20.831203 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:35:20.951886 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-41f80aca-1881-4de1-a79d-dc5f0de0572c tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:20.959918 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-41f80aca-1881-4de1-a79d-dc5f0de0572c tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118" status: 200 len: 1733 microversion: 2.1 time: 0.169213 May 19 13:35:20.960497 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 266/514] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:35:20 2022] GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118 => generated 1733 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:35:21.982598 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-51f9ccc1-0350-43b1-a947-160b042a4e1a tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:21.983208 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-51f9ccc1-0350-43b1-a947-160b042a4e1a tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: 8a3b02c0-6943-45dc-9086-16ff29536118] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:21.990290 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-51f9ccc1-0350-43b1-a947-160b042a4e1a tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:21.990704 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-51f9ccc1-0350-43b1-a947-160b042a4e1a tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:21.991584 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-51f9ccc1-0350-43b1-a947-160b042a4e1a tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:21.991913 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-51f9ccc1-0350-43b1-a947-160b042a4e1a tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:22.133171 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-51f9ccc1-0350-43b1-a947-160b042a4e1a tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:22.141254 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-51f9ccc1-0350-43b1-a947-160b042a4e1a tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118" status: 200 len: 1733 microversion: 2.1 time: 0.162600 May 19 13:35:22.141842 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 249/515] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:35:21 2022] GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118 => generated 1733 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:35:23.159519 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-44c78a43-acf2-4276-90f9-8f4fecd2032c tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:23.160148 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-44c78a43-acf2-4276-90f9-8f4fecd2032c tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: 8a3b02c0-6943-45dc-9086-16ff29536118] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:23.167415 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-44c78a43-acf2-4276-90f9-8f4fecd2032c tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:23.167860 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-44c78a43-acf2-4276-90f9-8f4fecd2032c tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:23.168940 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-44c78a43-acf2-4276-90f9-8f4fecd2032c tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:23.169368 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-44c78a43-acf2-4276-90f9-8f4fecd2032c tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:23.320968 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-44c78a43-acf2-4276-90f9-8f4fecd2032c tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:23.329683 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-44c78a43-acf2-4276-90f9-8f4fecd2032c tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118" status: 200 len: 1733 microversion: 2.1 time: 0.174182 May 19 13:35:23.330483 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 267/516] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:35:23 2022] GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118 => generated 1733 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:35:23.540661 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-982e05db-a560-4b44-ae9f-d035d762da3d tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:23.541227 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-982e05db-a560-4b44-ae9f-d035d762da3d tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:23.548490 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-982e05db-a560-4b44-ae9f-d035d762da3d tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:23.548929 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-982e05db-a560-4b44-ae9f-d035d762da3d tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:23.549716 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-982e05db-a560-4b44-ae9f-d035d762da3d tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:23.550159 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-982e05db-a560-4b44-ae9f-d035d762da3d tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:23.580868 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-982e05db-a560-4b44-ae9f-d035d762da3d tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10/os-volume_attachments/3e99d11c-8447-4649-a343-7b291790bd83" status: 200 len: 194 microversion: 2.20 time: 0.044293 May 19 13:35:23.581479 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 250/517] 10.222.0.24 () {60 vars in 1453 bytes} [Thu May 19 13:35:23 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10/os-volume_attachments/3e99d11c-8447-4649-a343-7b291790bd83 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 13:35:23.648715 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-bd38184e-109f-46ad-a18c-fdd75829f2fb tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:23.649294 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-bd38184e-109f-46ad-a18c-fdd75829f2fb tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:23.656263 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-bd38184e-109f-46ad-a18c-fdd75829f2fb tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:23.656847 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-bd38184e-109f-46ad-a18c-fdd75829f2fb tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:23.657659 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-bd38184e-109f-46ad-a18c-fdd75829f2fb tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:23.658091 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-bd38184e-109f-46ad-a18c-fdd75829f2fb tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:23.785205 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.objects.instance [None req-bd38184e-109f-46ad-a18c-fdd75829f2fb tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lazy-loading 'services' on Instance uuid 323322ec-2e2e-424b-a411-8a34069bcf10 {{(pid=120471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 13:35:23.903613 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-bd38184e-109f-46ad-a18c-fdd75829f2fb tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "DELETE /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10/os-volume_attachments/3e99d11c-8447-4649-a343-7b291790bd83" status: 202 len: 0 microversion: 2.20 time: 0.259459 May 19 13:35:23.904232 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 268/518] 10.222.0.24 () {60 vars in 1456 bytes} [Thu May 19 13:35:23 2022] DELETE /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10/os-volume_attachments/3e99d11c-8447-4649-a343-7b291790bd83 => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 19 13:35:23.918688 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-568f5321-a3f5-4c90-aea4-e542886377af tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:23.919748 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-568f5321-a3f5-4c90-aea4-e542886377af tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:23.925901 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-568f5321-a3f5-4c90-aea4-e542886377af tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:23.926383 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-568f5321-a3f5-4c90-aea4-e542886377af tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:23.927421 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-568f5321-a3f5-4c90-aea4-e542886377af tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:23.927880 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-568f5321-a3f5-4c90-aea4-e542886377af tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:23.958193 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-568f5321-a3f5-4c90-aea4-e542886377af tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049229 May 19 13:35:23.958761 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 251/519] 10.222.0.24 () {60 vars in 1342 bytes} [Thu May 19 13:35:23 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 19 13:35:24.352920 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-2d6e0ac7-7265-403b-a308-236c9ea57cb3 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:24.355728 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-2d6e0ac7-7265-403b-a308-236c9ea57cb3 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: 8a3b02c0-6943-45dc-9086-16ff29536118] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:24.367307 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-2d6e0ac7-7265-403b-a308-236c9ea57cb3 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:24.367781 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-2d6e0ac7-7265-403b-a308-236c9ea57cb3 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:24.368548 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-2d6e0ac7-7265-403b-a308-236c9ea57cb3 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:24.369013 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-2d6e0ac7-7265-403b-a308-236c9ea57cb3 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:24.509726 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-2d6e0ac7-7265-403b-a308-236c9ea57cb3 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:24.518235 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-2d6e0ac7-7265-403b-a308-236c9ea57cb3 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118" status: 200 len: 1733 microversion: 2.1 time: 0.173137 May 19 13:35:24.518866 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 269/520] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:35:24 2022] GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118 => generated 1733 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:35:24.973527 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-e30357d2-e9e3-43fd-afde-3c44332786c7 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:24.974874 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-e30357d2-e9e3-43fd-afde-3c44332786c7 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:24.986181 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-e30357d2-e9e3-43fd-afde-3c44332786c7 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:24.986924 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-e30357d2-e9e3-43fd-afde-3c44332786c7 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:24.988173 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-e30357d2-e9e3-43fd-afde-3c44332786c7 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:24.988884 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-e30357d2-e9e3-43fd-afde-3c44332786c7 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:24.993890 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:35:25.021938 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-e30357d2-e9e3-43fd-afde-3c44332786c7 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055233 May 19 13:35:25.022488 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 252/521] 10.222.0.24 () {60 vars in 1342 bytes} [Thu May 19 13:35:24 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 13:35:25.539949 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-1e1cb7df-92b9-47a7-82f6-1b58944913ae tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:25.540827 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-1e1cb7df-92b9-47a7-82f6-1b58944913ae tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: 8a3b02c0-6943-45dc-9086-16ff29536118] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:25.545031 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_api:SELECT=42 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:35:25.554303 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-1e1cb7df-92b9-47a7-82f6-1b58944913ae tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:25.554624 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-1e1cb7df-92b9-47a7-82f6-1b58944913ae tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:25.555377 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-1e1cb7df-92b9-47a7-82f6-1b58944913ae tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:25.555803 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-1e1cb7df-92b9-47a7-82f6-1b58944913ae tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:25.700901 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-1e1cb7df-92b9-47a7-82f6-1b58944913ae tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:25.709847 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-1e1cb7df-92b9-47a7-82f6-1b58944913ae tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118" status: 200 len: 1733 microversion: 2.1 time: 0.176566 May 19 13:35:25.710455 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 270/522] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:35:25 2022] GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118 => generated 1733 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:35:26.033871 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-38d18acf-7111-46a0-8214-2e891b9e72e5 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:26.034831 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-38d18acf-7111-46a0-8214-2e891b9e72e5 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:26.041833 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-38d18acf-7111-46a0-8214-2e891b9e72e5 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:26.042280 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-38d18acf-7111-46a0-8214-2e891b9e72e5 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:26.043068 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-38d18acf-7111-46a0-8214-2e891b9e72e5 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:26.043809 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-38d18acf-7111-46a0-8214-2e891b9e72e5 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:26.074980 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-38d18acf-7111-46a0-8214-2e891b9e72e5 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045097 May 19 13:35:26.075535 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 253/523] 10.222.0.24 () {60 vars in 1342 bytes} [Thu May 19 13:35:26 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 13:35:26.731895 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-5245eb59-43eb-4b4c-9af9-1594a91b6dac tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:26.732940 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-5245eb59-43eb-4b4c-9af9-1594a91b6dac tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: 8a3b02c0-6943-45dc-9086-16ff29536118] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:26.744537 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-5245eb59-43eb-4b4c-9af9-1594a91b6dac tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:26.745278 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-5245eb59-43eb-4b4c-9af9-1594a91b6dac tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:26.746627 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-5245eb59-43eb-4b4c-9af9-1594a91b6dac tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:26.747344 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-5245eb59-43eb-4b4c-9af9-1594a91b6dac tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:27.088701 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-b963e2bb-dff4-4bd0-a630-d5798faa5620 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:27.089656 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-b963e2bb-dff4-4bd0-a630-d5798faa5620 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:27.096338 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-b963e2bb-dff4-4bd0-a630-d5798faa5620 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:27.096788 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-b963e2bb-dff4-4bd0-a630-d5798faa5620 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:27.097573 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-b963e2bb-dff4-4bd0-a630-d5798faa5620 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:27.097976 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-b963e2bb-dff4-4bd0-a630-d5798faa5620 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:27.110400 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-5245eb59-43eb-4b4c-9af9-1594a91b6dac tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:27.119246 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-5245eb59-43eb-4b4c-9af9-1594a91b6dac tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118" status: 200 len: 1733 microversion: 2.1 time: 0.394197 May 19 13:35:27.119819 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 271/524] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:35:26 2022] GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118 => generated 1733 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:35:27.128560 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-b963e2bb-dff4-4bd0-a630-d5798faa5620 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044041 May 19 13:35:27.129435 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 254/525] 10.222.0.24 () {60 vars in 1342 bytes} [Thu May 19 13:35:27 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 13:35:28.137876 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-3d948f9b-a4b0-4af3-b091-42dc8054d54e tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:28.138471 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-3d948f9b-a4b0-4af3-b091-42dc8054d54e tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: 8a3b02c0-6943-45dc-9086-16ff29536118] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:28.140377 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-45ffbd08-7c3a-4906-bc00-fadc8deb7cce tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:28.141307 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-45ffbd08-7c3a-4906-bc00-fadc8deb7cce tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:28.144880 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-3d948f9b-a4b0-4af3-b091-42dc8054d54e tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:28.145337 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-3d948f9b-a4b0-4af3-b091-42dc8054d54e tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:28.146152 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-3d948f9b-a4b0-4af3-b091-42dc8054d54e tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:28.146730 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-3d948f9b-a4b0-4af3-b091-42dc8054d54e tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:28.148839 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-45ffbd08-7c3a-4906-bc00-fadc8deb7cce tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:28.149286 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-45ffbd08-7c3a-4906-bc00-fadc8deb7cce tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:28.150102 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-45ffbd08-7c3a-4906-bc00-fadc8deb7cce tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:28.150527 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-45ffbd08-7c3a-4906-bc00-fadc8deb7cce tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:28.182030 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-45ffbd08-7c3a-4906-bc00-fadc8deb7cce tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045598 May 19 13:35:28.182860 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 255/526] 10.222.0.24 () {60 vars in 1342 bytes} [Thu May 19 13:35:28 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 13:35:28.290708 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-3d948f9b-a4b0-4af3-b091-42dc8054d54e tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:28.299660 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-3d948f9b-a4b0-4af3-b091-42dc8054d54e tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118" status: 200 len: 1733 microversion: 2.1 time: 0.166545 May 19 13:35:28.300225 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 272/527] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:35:28 2022] GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118 => generated 1733 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:35:29.198506 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-4b73ce68-d062-4b80-be48-2c829f35c455 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:29.199505 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-4b73ce68-d062-4b80-be48-2c829f35c455 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:29.206669 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-4b73ce68-d062-4b80-be48-2c829f35c455 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:29.207114 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-4b73ce68-d062-4b80-be48-2c829f35c455 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:29.207868 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-4b73ce68-d062-4b80-be48-2c829f35c455 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:29.208293 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-4b73ce68-d062-4b80-be48-2c829f35c455 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:29.239014 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-4b73ce68-d062-4b80-be48-2c829f35c455 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047606 May 19 13:35:29.239568 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 256/528] 10.222.0.24 () {60 vars in 1342 bytes} [Thu May 19 13:35:29 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:35:29.300128 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-a2a689d1-280f-460f-8b26-91f16bd9d2b2 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:29.300641 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-a2a689d1-280f-460f-8b26-91f16bd9d2b2 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:29.307511 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-a2a689d1-280f-460f-8b26-91f16bd9d2b2 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:29.307950 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-a2a689d1-280f-460f-8b26-91f16bd9d2b2 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:29.308698 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-a2a689d1-280f-460f-8b26-91f16bd9d2b2 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:29.309118 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-a2a689d1-280f-460f-8b26-91f16bd9d2b2 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:29.317100 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-83affd72-4d11-4edc-91be-ba2b1eb7dfee tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:29.317741 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-83affd72-4d11-4edc-91be-ba2b1eb7dfee tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: 8a3b02c0-6943-45dc-9086-16ff29536118] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:29.324104 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-83affd72-4d11-4edc-91be-ba2b1eb7dfee tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:29.324554 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-83affd72-4d11-4edc-91be-ba2b1eb7dfee tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:29.325318 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-83affd72-4d11-4edc-91be-ba2b1eb7dfee tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:29.325779 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-83affd72-4d11-4edc-91be-ba2b1eb7dfee tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:29.334803 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-a2a689d1-280f-460f-8b26-91f16bd9d2b2 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Going to try to terminate instance {{(pid=120471) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 13:35:29.413553 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-a2a689d1-280f-460f-8b26-91f16bd9d2b2 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "DELETE /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 204 len: 0 microversion: 2.20 time: 0.116977 May 19 13:35:29.414152 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 273/529] 10.222.0.24 () {60 vars in 1279 bytes} [Thu May 19 13:35:29 2022] DELETE /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 19 13:35:29.423387 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-015089d5-6180-4bf7-9c92-b19ec741d162 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:29.424179 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-015089d5-6180-4bf7-9c92-b19ec741d162 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:29.431664 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-015089d5-6180-4bf7-9c92-b19ec741d162 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:29.432124 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-015089d5-6180-4bf7-9c92-b19ec741d162 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:29.433455 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-015089d5-6180-4bf7-9c92-b19ec741d162 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:29.434071 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-015089d5-6180-4bf7-9c92-b19ec741d162 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:29.462617 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-83affd72-4d11-4edc-91be-ba2b1eb7dfee tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:29.471037 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-83affd72-4d11-4edc-91be-ba2b1eb7dfee tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118" status: 200 len: 1733 microversion: 2.1 time: 0.157695 May 19 13:35:29.471692 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 257/530] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:35:29 2022] GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118 => generated 1733 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:35:29.571807 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-015089d5-6180-4bf7-9c92-b19ec741d162 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:29.579982 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-015089d5-6180-4bf7-9c92-b19ec741d162 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:29.581452 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-015089d5-6180-4bf7-9c92-b19ec741d162 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:29.582599 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-015089d5-6180-4bf7-9c92-b19ec741d162 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1724 microversion: 2.20 time: 0.163569 May 19 13:35:29.583152 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 274/531] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:35:29 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:35:30.492317 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-54b650f8-209b-4789-93b2-8f5a0a865c54 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:30.493311 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-54b650f8-209b-4789-93b2-8f5a0a865c54 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: 8a3b02c0-6943-45dc-9086-16ff29536118] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:30.501237 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-54b650f8-209b-4789-93b2-8f5a0a865c54 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:30.501715 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-54b650f8-209b-4789-93b2-8f5a0a865c54 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:30.502471 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-54b650f8-209b-4789-93b2-8f5a0a865c54 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:30.502902 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-54b650f8-209b-4789-93b2-8f5a0a865c54 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:30.604497 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-4aca6b96-891a-48ac-a83c-e9a8e294d6fa tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:30.605118 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-4aca6b96-891a-48ac-a83c-e9a8e294d6fa tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:30.614240 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-4aca6b96-891a-48ac-a83c-e9a8e294d6fa tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:30.614953 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-4aca6b96-891a-48ac-a83c-e9a8e294d6fa tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:30.616144 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-4aca6b96-891a-48ac-a83c-e9a8e294d6fa tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:30.616803 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-4aca6b96-891a-48ac-a83c-e9a8e294d6fa tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:30.638218 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-54b650f8-209b-4789-93b2-8f5a0a865c54 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:30.646892 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-54b650f8-209b-4789-93b2-8f5a0a865c54 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118" status: 200 len: 1733 microversion: 2.1 time: 0.161110 May 19 13:35:30.647471 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 258/532] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:35:30 2022] GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118 => generated 1733 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:35:30.753073 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-4aca6b96-891a-48ac-a83c-e9a8e294d6fa tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:30.761352 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-4aca6b96-891a-48ac-a83c-e9a8e294d6fa tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:30.762883 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-4aca6b96-891a-48ac-a83c-e9a8e294d6fa tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:30.764037 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-4aca6b96-891a-48ac-a83c-e9a8e294d6fa tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1724 microversion: 2.20 time: 0.163896 May 19 13:35:30.764597 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 275/533] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:35:30 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:35:31.668673 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-97429547-3cc4-4527-8659-a400c17b3c11 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:31.669446 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-97429547-3cc4-4527-8659-a400c17b3c11 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: 8a3b02c0-6943-45dc-9086-16ff29536118] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:31.677378 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-97429547-3cc4-4527-8659-a400c17b3c11 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:31.677952 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-97429547-3cc4-4527-8659-a400c17b3c11 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:31.678844 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-97429547-3cc4-4527-8659-a400c17b3c11 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:31.679353 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-97429547-3cc4-4527-8659-a400c17b3c11 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:31.783100 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-62b37663-6068-4ee4-83c3-3e97d68fdcda tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:31.784147 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-62b37663-6068-4ee4-83c3-3e97d68fdcda tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:31.791264 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-62b37663-6068-4ee4-83c3-3e97d68fdcda tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:31.791979 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-62b37663-6068-4ee4-83c3-3e97d68fdcda tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:31.792847 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-62b37663-6068-4ee4-83c3-3e97d68fdcda tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:31.794029 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-62b37663-6068-4ee4-83c3-3e97d68fdcda tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:31.827650 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-97429547-3cc4-4527-8659-a400c17b3c11 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:31.835698 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-97429547-3cc4-4527-8659-a400c17b3c11 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118" status: 200 len: 1733 microversion: 2.1 time: 0.173717 May 19 13:35:31.836269 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 259/534] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:35:31 2022] GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118 => generated 1733 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:35:32.024676 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-62b37663-6068-4ee4-83c3-3e97d68fdcda tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:32.033170 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-62b37663-6068-4ee4-83c3-3e97d68fdcda tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:32.034677 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-62b37663-6068-4ee4-83c3-3e97d68fdcda tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:32.035817 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-62b37663-6068-4ee4-83c3-3e97d68fdcda tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1724 microversion: 2.20 time: 0.256731 May 19 13:35:32.036370 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 276/535] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:35:31 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1724 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 13:35:32.065365 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-1abab9f1-c1fe-4fb3-8eb1-74f40eeee707 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:32.065875 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-1abab9f1-c1fe-4fb3-8eb1-74f40eeee707 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] [instance: 7c295eb7-8e9f-436b-8e36-05adc8fbfcf4] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:32.072494 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-1abab9f1-c1fe-4fb3-8eb1-74f40eeee707 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:32.072940 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-1abab9f1-c1fe-4fb3-8eb1-74f40eeee707 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:32.074132 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-1abab9f1-c1fe-4fb3-8eb1-74f40eeee707 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:32.074630 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-1abab9f1-c1fe-4fb3-8eb1-74f40eeee707 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:32.157451 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.objects.instance [None req-1abab9f1-c1fe-4fb3-8eb1-74f40eeee707 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lazy-loading 'services' on Instance uuid 7c295eb7-8e9f-436b-8e36-05adc8fbfcf4 {{(pid=120472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 13:35:32.232775 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-1abab9f1-c1fe-4fb3-8eb1-74f40eeee707 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] 10.222.0.24 "DELETE /compute/v2.1/servers/7c295eb7-8e9f-436b-8e36-05adc8fbfcf4/os-volume_attachments/efd6a762-e5a9-4fb2-bdbe-ef098c94d1f3" status: 202 len: 0 microversion: 2.1 time: 0.171175 May 19 13:35:32.233359 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 260/536] 10.222.0.24 () {58 vars in 1415 bytes} [Thu May 19 13:35:32 2022] DELETE /compute/v2.1/servers/7c295eb7-8e9f-436b-8e36-05adc8fbfcf4/os-volume_attachments/efd6a762-e5a9-4fb2-bdbe-ef098c94d1f3 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 13:35:32.665318 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [req-e197fe1f-4af3-41bf-b428-6fe5ed652a93 req-16ea37a9-352e-4537-a818-b51e9f7b7ef3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "323322ec-2e2e-424b-a411-8a34069bcf10", "name": "network-vif-deleted", "tag": "1ae6b782-184e-4357-ab26-9a0648e0a6a3"}]} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:35:32.675270 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-e197fe1f-4af3-41bf-b428-6fe5ed652a93 req-16ea37a9-352e-4537-a818-b51e9f7b7ef3 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:32.675804 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-e197fe1f-4af3-41bf-b428-6fe5ed652a93 req-16ea37a9-352e-4537-a818-b51e9f7b7ef3 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:32.687909 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.compute.server_external_events [req-e197fe1f-4af3-41bf-b428-6fe5ed652a93 req-16ea37a9-352e-4537-a818-b51e9f7b7ef3 service nova] Creating event network-vif-deleted:1ae6b782-184e-4357-ab26-9a0648e0a6a3 for instance 323322ec-2e2e-424b-a411-8a34069bcf10 on hv-cinder-84112 May 19 13:35:32.693326 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [req-e197fe1f-4af3-41bf-b428-6fe5ed652a93 req-16ea37a9-352e-4537-a818-b51e9f7b7ef3 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031744 May 19 13:35:32.694674 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 277/537] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:35:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:35:32.858166 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-b3a6db68-6545-4a82-8ece-600875f57298 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:32.860316 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-b3a6db68-6545-4a82-8ece-600875f57298 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: 8a3b02c0-6943-45dc-9086-16ff29536118] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:32.870206 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-b3a6db68-6545-4a82-8ece-600875f57298 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:32.871312 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-b3a6db68-6545-4a82-8ece-600875f57298 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:32.872337 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-b3a6db68-6545-4a82-8ece-600875f57298 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:32.872965 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-b3a6db68-6545-4a82-8ece-600875f57298 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:33.043184 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-b3a6db68-6545-4a82-8ece-600875f57298 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:33.055112 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-b3a6db68-6545-4a82-8ece-600875f57298 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118" status: 200 len: 1733 microversion: 2.1 time: 0.204636 May 19 13:35:33.056061 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 261/538] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:35:32 2022] GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118 => generated 1733 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:35:33.065240 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-b7c8bf99-f1cc-43c9-897d-0105e21d1a98 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:33.066153 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-b7c8bf99-f1cc-43c9-897d-0105e21d1a98 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:33.072903 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-b7c8bf99-f1cc-43c9-897d-0105e21d1a98 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:33.073399 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-b7c8bf99-f1cc-43c9-897d-0105e21d1a98 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:33.074324 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-b7c8bf99-f1cc-43c9-897d-0105e21d1a98 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:33.074836 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-b7c8bf99-f1cc-43c9-897d-0105e21d1a98 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:33.105305 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-b7c8bf99-f1cc-43c9-897d-0105e21d1a98 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:33.105783 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-b7c8bf99-f1cc-43c9-897d-0105e21d1a98 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:33.106219 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.objects.instance [None req-b7c8bf99-f1cc-43c9-897d-0105e21d1a98 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lazy-loading 'fault' on Instance uuid 323322ec-2e2e-424b-a411-8a34069bcf10 {{(pid=120471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 13:35:33.152293 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-b7c8bf99-f1cc-43c9-897d-0105e21d1a98 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:33.160475 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-b7c8bf99-f1cc-43c9-897d-0105e21d1a98 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:33.162020 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-b7c8bf99-f1cc-43c9-897d-0105e21d1a98 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:33.163159 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-b7c8bf99-f1cc-43c9-897d-0105e21d1a98 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 200 len: 1372 microversion: 2.20 time: 0.111868 May 19 13:35:33.163751 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 278/539] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:35:33 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 1372 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 13:35:33.363354 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-85d62b38-45f3-4bf7-bb51-26cc30ee97d2 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:33.363821 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-85d62b38-45f3-4bf7-bb51-26cc30ee97d2 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] [instance: 7c295eb7-8e9f-436b-8e36-05adc8fbfcf4] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:33.371305 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-85d62b38-45f3-4bf7-bb51-26cc30ee97d2 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:33.372325 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-85d62b38-45f3-4bf7-bb51-26cc30ee97d2 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:33.373321 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-85d62b38-45f3-4bf7-bb51-26cc30ee97d2 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:33.373969 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-85d62b38-45f3-4bf7-bb51-26cc30ee97d2 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:33.404393 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-85d62b38-45f3-4bf7-bb51-26cc30ee97d2 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] [instance: 7c295eb7-8e9f-436b-8e36-05adc8fbfcf4] Going to try to terminate instance {{(pid=120472) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 13:35:33.516014 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-85d62b38-45f3-4bf7-bb51-26cc30ee97d2 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] 10.222.0.24 "DELETE /compute/v2.1/servers/7c295eb7-8e9f-436b-8e36-05adc8fbfcf4" status: 204 len: 0 microversion: 2.1 time: 0.156464 May 19 13:35:33.516593 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 262/540] 10.222.0.24 () {58 vars in 1238 bytes} [Thu May 19 13:35:33 2022] DELETE /compute/v2.1/servers/7c295eb7-8e9f-436b-8e36-05adc8fbfcf4 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 13:35:33.528534 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-644c6ace-ab05-4b52-ae9c-4794a69fbbe3 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:33.529615 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-644c6ace-ab05-4b52-ae9c-4794a69fbbe3 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] [instance: 7c295eb7-8e9f-436b-8e36-05adc8fbfcf4] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:33.551673 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-644c6ace-ab05-4b52-ae9c-4794a69fbbe3 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:33.552278 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-644c6ace-ab05-4b52-ae9c-4794a69fbbe3 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:33.553254 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-644c6ace-ab05-4b52-ae9c-4794a69fbbe3 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:33.553844 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-644c6ace-ab05-4b52-ae9c-4794a69fbbe3 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:33.705586 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-644c6ace-ab05-4b52-ae9c-4794a69fbbe3 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26c50b54171491b987ca844091c6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96a605108ec47a081c60bc8dc16fd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:33.713375 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-644c6ace-ab05-4b52-ae9c-4794a69fbbe3 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] 10.222.0.24 "GET /compute/v2.1/servers/7c295eb7-8e9f-436b-8e36-05adc8fbfcf4" status: 200 len: 1511 microversion: 2.1 time: 0.191641 May 19 13:35:33.714031 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 279/541] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:35:33 2022] GET /compute/v2.1/servers/7c295eb7-8e9f-436b-8e36-05adc8fbfcf4 => generated 1511 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:35:34.073035 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-e2d4f8a8-b5a9-4db6-81c0-e9697d7442c7 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:34.073886 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-e2d4f8a8-b5a9-4db6-81c0-e9697d7442c7 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: 8a3b02c0-6943-45dc-9086-16ff29536118] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:34.081727 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-e2d4f8a8-b5a9-4db6-81c0-e9697d7442c7 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:34.082351 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-e2d4f8a8-b5a9-4db6-81c0-e9697d7442c7 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:34.083608 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-e2d4f8a8-b5a9-4db6-81c0-e9697d7442c7 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:34.084223 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-e2d4f8a8-b5a9-4db6-81c0-e9697d7442c7 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:34.182240 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-306858a1-1f5f-434e-b77d-3bb2cac44d72 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:34.183293 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-306858a1-1f5f-434e-b77d-3bb2cac44d72 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:34.190074 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-306858a1-1f5f-434e-b77d-3bb2cac44d72 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:34.190516 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-306858a1-1f5f-434e-b77d-3bb2cac44d72 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:34.191313 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-306858a1-1f5f-434e-b77d-3bb2cac44d72 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:34.191768 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-306858a1-1f5f-434e-b77d-3bb2cac44d72 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:34.206707 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.wsgi [None req-306858a1-1f5f-434e-b77d-3bb2cac44d72 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] HTTP exception thrown: Instance 323322ec-2e2e-424b-a411-8a34069bcf10 could not be found. May 19 13:35:34.208469 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-306858a1-1f5f-434e-b77d-3bb2cac44d72 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Request method failure captured: May 19 13:35:34.208469 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: request: GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 HTTP/1.1 May 19 13:35:34.208469 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Accept: application/json May 19 13:35:34.208469 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Accept-Encoding: identity May 19 13:35:34.208469 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Connection: close May 19 13:35:34.208469 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Content-Length: 0 May 19 13:35:34.208469 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Content-Type: application/json May 19 13:35:34.208469 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Host: 10.222.0.24 May 19 13:35:34.208469 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Openstack-System-Scope: None May 19 13:35:34.208469 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: User-Agent: python-urllib3/1.26.9 May 19 13:35:34.208469 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Auth-Token: gAAAAABihkauRwg9SZEVw8gMHHhviMqezzbqwi1XD-02SuOQeJ9H4KRkjWE4j7V6GJW7YEwT2tOV0hmurH7qs_Ror_AWRGpqgWKh-NLVf798ZxYTjf97Zcrj1RBWWF336W5I9d_IzMxCCYaUy4ClKqFGwyR_G6Sj2cN27XBLguIHeRUJfQI8In4 May 19 13:35:34.208469 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Domain-Id: None May 19 13:35:34.208469 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Domain-Name: None May 19 13:35:34.208469 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Identity-Status: Confirmed May 19 13:35:34.208469 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Is-Admin-Project: True May 19 13:35:34.208469 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Openstack-Nova-Api-Version: 2.20 May 19 13:35:34.208469 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Domain-Id: default May 19 13:35:34.208469 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Domain-Name: Default May 19 13:35:34.208469 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Id: 959c5c84bd724d2688f435b15b41f1c8 May 19 13:35:34.208469 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-939349313 May 19 13:35:34.208469 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Role: reader,member May 19 13:35:34.208469 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Roles: reader,member May 19 13:35:34.210003 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/959c5c84bd724d2688f435b15b41f1c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/959c5c84bd724d2688f435b15b41f1c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_959c5c84bd724d2688f435b15b41f1c8", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/959c5c84bd724d2688f435b15b41f1c8"}]}] May 19 13:35:34.210003 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Tenant: tempest-AttachVolumeShelveTestJSON-939349313 May 19 13:35:34.210003 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Tenant-Id: 959c5c84bd724d2688f435b15b41f1c8 May 19 13:35:34.210003 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-939349313 May 19 13:35:34.210003 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User: tempest-AttachVolumeShelveTestJSON-939349313-project May 19 13:35:34.210003 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Domain-Id: default May 19 13:35:34.210003 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Domain-Name: Default May 19 13:35:34.210003 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Id: 14da69798e344e70ba64bf8187523e45 May 19 13:35:34.210003 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Name: tempest-AttachVolumeShelveTestJSON-939349313-project May 19 13:35:34.210003 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: method: > May 19 13:35:34.210003 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: exception: Instance 323322ec-2e2e-424b-a411-8a34069bcf10 could not be found. May 19 13:35:34.210003 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: action_args: {'id': '323322ec-2e2e-424b-a411-8a34069bcf10'} May 19 13:35:34.211454 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:35:34.211454 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:35:34.211454 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 13:35:34.211454 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 13:35:34.211454 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 13:35:34.211454 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 13:35:34.211454 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 13:35:34.211454 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 13:35:34.211454 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 13:35:34.211454 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 13:35:34.211454 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 323322ec-2e2e-424b-a411-8a34069bcf10 could not be found. May 19 13:35:34.211454 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:35:34.211454 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:35:34.211454 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:35:34.211454 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:35:34.211454 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:35:34.211454 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:35:34.211454 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:35:34.211454 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:35:34.211454 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:35:34.212724 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:35:34.212724 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 13:35:34.212724 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 13:35:34.212724 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 13:35:34.212724 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 13:35:34.212724 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 13:35:34.212724 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 13:35:34.212724 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 323322ec-2e2e-424b-a411-8a34069bcf10 could not be found. May 19 13:35:34.212724 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:35:34.212724 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:35:34.212724 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:35:34.212724 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:35:34.212724 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:35:34.212724 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:35:34.212724 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:35:34.212724 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:35:34.212724 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 323322ec-2e2e-424b-a411-8a34069bcf10 could not be found. May 19 13:35:34.212724 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:35:34.215248 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-306858a1-1f5f-434e-b77d-3bb2cac44d72 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Returning 404 to user: Instance 323322ec-2e2e-424b-a411-8a34069bcf10 could not be found. {{(pid=120471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:35:34.215248 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-306858a1-1f5f-434e-b77d-3bb2cac44d72 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 404 len: 111 microversion: 2.20 time: 0.031660 May 19 13:35:34.215248 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 280/542] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:35:34 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 13:35:34.219951 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-5a2c61cd-57af-4e0a-b7ff-acff51df2244 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '.version_select at 0x7f7c2af473a0>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:34.222538 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-e2d4f8a8-b5a9-4db6-81c0-e9697d7442c7 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:34.233196 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-e2d4f8a8-b5a9-4db6-81c0-e9697d7442c7 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118" status: 200 len: 1733 microversion: 2.1 time: 0.164372 May 19 13:35:34.233853 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 263/543] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:35:34 2022] GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118 => generated 1733 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:35:34.261734 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-5a2c61cd-57af-4e0a-b7ff-acff51df2244 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1913081529" status: 204 len: 0 microversion: 2.20 time: 0.045492 May 19 13:35:34.263058 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 281/544] 10.222.0.24 () {60 vars in 1261 bytes} [Thu May 19 13:35:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1913081529 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 19 13:35:34.731493 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-e24313d1-306d-4ca5-88c2-34ce6e62bc6f tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:34.732238 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-e24313d1-306d-4ca5-88c2-34ce6e62bc6f tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] [instance: 7c295eb7-8e9f-436b-8e36-05adc8fbfcf4] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:34.739084 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-e24313d1-306d-4ca5-88c2-34ce6e62bc6f tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:34.739532 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-e24313d1-306d-4ca5-88c2-34ce6e62bc6f tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:34.740260 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-e24313d1-306d-4ca5-88c2-34ce6e62bc6f tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:34.740923 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-e24313d1-306d-4ca5-88c2-34ce6e62bc6f tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:34.883690 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-e24313d1-306d-4ca5-88c2-34ce6e62bc6f tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26c50b54171491b987ca844091c6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96a605108ec47a081c60bc8dc16fd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:34.895799 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-e24313d1-306d-4ca5-88c2-34ce6e62bc6f tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] 10.222.0.24 "GET /compute/v2.1/servers/7c295eb7-8e9f-436b-8e36-05adc8fbfcf4" status: 200 len: 1511 microversion: 2.1 time: 0.168388 May 19 13:35:34.896897 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 264/545] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:35:34 2022] GET /compute/v2.1/servers/7c295eb7-8e9f-436b-8e36-05adc8fbfcf4 => generated 1511 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:35:34.950257 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-530ad6f3-a0a7-4b5e-b970-8ce1c7c4fd5b tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Action: 'create', calling method: .version_select at 0x7f7c2aeba790>, body: {"keypair": {"name": "tempest-keypair-400685449", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA5nqpJ9bgHuN3kCkaWSZ04h7KZ84+1CdRgaLbvnFUo1tlBrUKQmiqiSowI6MpQgpivaMTuhaZFjZxMOR/EnSxIABp4jTm/Bd6yk5GiDT//Ij1xtPavEjj302D7SAxGuWw=="}} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:35:34.968673 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.quota [None req-530ad6f3-a0a7-4b5e-b970-8ce1c7c4fd5b tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Getting quotas for project 959c5c84bd724d2688f435b15b41f1c8. Resources: {'key_pairs'} {{(pid=120471) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 13:35:34.972550 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.quota [None req-530ad6f3-a0a7-4b5e-b970-8ce1c7c4fd5b tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Getting quotas for user 14da69798e344e70ba64bf8187523e45 and project 959c5c84bd724d2688f435b15b41f1c8. Resources: {'key_pairs'} {{(pid=120471) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 13:35:34.997050 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-530ad6f3-a0a7-4b5e-b970-8ce1c7c4fd5b tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.051162 May 19 13:35:34.997677 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 282/546] 10.222.0.24 () {62 vars in 1199 bytes} [Thu May 19 13:35:34 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 52 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 19 13:35:35.250389 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-2d0b9f8e-0150-4789-9618-3e20a68c8234 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:35.251610 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-2d0b9f8e-0150-4789-9618-3e20a68c8234 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: 8a3b02c0-6943-45dc-9086-16ff29536118] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:35.262094 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-2d0b9f8e-0150-4789-9618-3e20a68c8234 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:35.262802 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-2d0b9f8e-0150-4789-9618-3e20a68c8234 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:35.264336 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-2d0b9f8e-0150-4789-9618-3e20a68c8234 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:35.264759 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-2d0b9f8e-0150-4789-9618-3e20a68c8234 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:35.440621 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-2d0b9f8e-0150-4789-9618-3e20a68c8234 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:35.450056 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-2d0b9f8e-0150-4789-9618-3e20a68c8234 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118" status: 200 len: 1733 microversion: 2.1 time: 0.203473 May 19 13:35:35.450707 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 265/547] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:35:35 2022] GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118 => generated 1733 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:35:35.914524 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-c7c9bade-7555-4195-963f-d38a8bea2893 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:35.916076 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-c7c9bade-7555-4195-963f-d38a8bea2893 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] [instance: 7c295eb7-8e9f-436b-8e36-05adc8fbfcf4] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:35.927139 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-c7c9bade-7555-4195-963f-d38a8bea2893 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:35.927599 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-c7c9bade-7555-4195-963f-d38a8bea2893 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:35.928419 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-c7c9bade-7555-4195-963f-d38a8bea2893 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:35.929015 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-c7c9bade-7555-4195-963f-d38a8bea2893 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:36.083211 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-c7c9bade-7555-4195-963f-d38a8bea2893 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26c50b54171491b987ca844091c6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96a605108ec47a081c60bc8dc16fd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:36.085600 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:35:36.092608 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-c7c9bade-7555-4195-963f-d38a8bea2893 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] 10.222.0.24 "GET /compute/v2.1/servers/7c295eb7-8e9f-436b-8e36-05adc8fbfcf4" status: 200 len: 1511 microversion: 2.1 time: 0.182300 May 19 13:35:36.093189 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 283/548] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:35:35 2022] GET /compute/v2.1/servers/7c295eb7-8e9f-436b-8e36-05adc8fbfcf4 => generated 1511 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:35:36.468409 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-b6f200af-c698-4be2-8e4d-7199c03d43e7 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:36.469701 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-b6f200af-c698-4be2-8e4d-7199c03d43e7 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: 8a3b02c0-6943-45dc-9086-16ff29536118] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:36.476073 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-b6f200af-c698-4be2-8e4d-7199c03d43e7 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:36.476713 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-b6f200af-c698-4be2-8e4d-7199c03d43e7 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:36.477694 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-b6f200af-c698-4be2-8e4d-7199c03d43e7 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:36.478171 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-b6f200af-c698-4be2-8e4d-7199c03d43e7 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:36.495690 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:35:36.636462 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [req-2286d0ed-a2e7-4984-94f6-c251d88acf03 req-f58d3799-abf8-46a8-aa5b-346b35a70ab0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c295eb7-8e9f-436b-8e36-05adc8fbfcf4", "name": "network-vif-deleted", "tag": "7edb5a95-96ac-49b8-96a4-f12c01ce4e38"}]} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:35:36.646006 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-2286d0ed-a2e7-4984-94f6-c251d88acf03 req-f58d3799-abf8-46a8-aa5b-346b35a70ab0 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:36.646373 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-2286d0ed-a2e7-4984-94f6-c251d88acf03 req-f58d3799-abf8-46a8-aa5b-346b35a70ab0 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:36.658193 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.compute.server_external_events [req-2286d0ed-a2e7-4984-94f6-c251d88acf03 req-f58d3799-abf8-46a8-aa5b-346b35a70ab0 service nova] Creating event network-vif-deleted:7edb5a95-96ac-49b8-96a4-f12c01ce4e38 for instance 7c295eb7-8e9f-436b-8e36-05adc8fbfcf4 on hv-cinder-84112 May 19 13:35:36.663380 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [req-2286d0ed-a2e7-4984-94f6-c251d88acf03 req-f58d3799-abf8-46a8-aa5b-346b35a70ab0 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031217 May 19 13:35:36.664222 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 284/549] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:35:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 13:35:36.732505 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-b6f200af-c698-4be2-8e4d-7199c03d43e7 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:36.749985 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-b6f200af-c698-4be2-8e4d-7199c03d43e7 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118" status: 200 len: 1733 microversion: 2.1 time: 0.286087 May 19 13:35:36.750975 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 266/550] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:35:36 2022] GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118 => generated 1733 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:35:36.875877 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-81eafd50-70ad-4a8b-8b60-40d227ff895e tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-511534578", "imageRef": "9beb860d-9c3f-4244-80aa-71a9c337a429", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "680a83a0-30ec-41c9-9148-fa9290c3fc14"}], "security_groups": [{"name": "tempest-securitygroup--1400787246"}], "key_name": "tempest-keypair-400685449", "user_data": "}} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:35:36.978799 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.network.neutron [None req-81eafd50-70ad-4a8b-8b60-40d227ff895e tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] validate_networks() for [('680a83a0-30ec-41c9-9148-fa9290c3fc14', None, None, None, None, None)] {{(pid=120471) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 13:35:37.110090 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-d6f82b1f-3e2d-49a0-9c84-1f070541ea44 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:37.110708 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-d6f82b1f-3e2d-49a0-9c84-1f070541ea44 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] [instance: 7c295eb7-8e9f-436b-8e36-05adc8fbfcf4] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:37.117188 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-d6f82b1f-3e2d-49a0-9c84-1f070541ea44 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:37.117951 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-d6f82b1f-3e2d-49a0-9c84-1f070541ea44 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:37.118724 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-d6f82b1f-3e2d-49a0-9c84-1f070541ea44 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:37.119123 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-d6f82b1f-3e2d-49a0-9c84-1f070541ea44 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:37.154026 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-d6f82b1f-3e2d-49a0-9c84-1f070541ea44 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:37.154477 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-d6f82b1f-3e2d-49a0-9c84-1f070541ea44 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:37.154925 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.objects.instance [None req-d6f82b1f-3e2d-49a0-9c84-1f070541ea44 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lazy-loading 'fault' on Instance uuid 7c295eb7-8e9f-436b-8e36-05adc8fbfcf4 {{(pid=120472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 13:35:37.212533 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-d6f82b1f-3e2d-49a0-9c84-1f070541ea44 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26c50b54171491b987ca844091c6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96a605108ec47a081c60bc8dc16fd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:37.221767 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-d6f82b1f-3e2d-49a0-9c84-1f070541ea44 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] 10.222.0.24 "GET /compute/v2.1/servers/7c295eb7-8e9f-436b-8e36-05adc8fbfcf4" status: 200 len: 1307 microversion: 2.1 time: 0.115288 May 19 13:35:37.222348 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 267/551] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:35:37 2022] GET /compute/v2.1/servers/7c295eb7-8e9f-436b-8e36-05adc8fbfcf4 => generated 1307 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:35:37.390989 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.virt.hardware [None req-81eafd50-70ad-4a8b-8b60-40d227ff895e tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Flavor limits 0:0:0 {{(pid=120471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 13:35:37.391405 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.virt.hardware [None req-81eafd50-70ad-4a8b-8b60-40d227ff895e tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Image limits 0:0:0 {{(pid=120471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 13:35:37.391865 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.virt.hardware [None req-81eafd50-70ad-4a8b-8b60-40d227ff895e tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Flavor pref 0:0:0 {{(pid=120471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 13:35:37.392262 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.virt.hardware [None req-81eafd50-70ad-4a8b-8b60-40d227ff895e tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Image pref 0:0:0 {{(pid=120471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 13:35:37.392662 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.virt.hardware [None req-81eafd50-70ad-4a8b-8b60-40d227ff895e tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 13:35:37.402333 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-81eafd50-70ad-4a8b-8b60-40d227ff895e tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:37.402765 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-81eafd50-70ad-4a8b-8b60-40d227ff895e tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:37.403607 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-81eafd50-70ad-4a8b-8b60-40d227ff895e tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:37.403977 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-81eafd50-70ad-4a8b-8b60-40d227ff895e tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:37.422299 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.quota [None req-81eafd50-70ad-4a8b-8b60-40d227ff895e tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Getting quotas for project 959c5c84bd724d2688f435b15b41f1c8. Resources: {'instances', 'cores', 'ram'} {{(pid=120471) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 13:35:37.426355 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.quota [None req-81eafd50-70ad-4a8b-8b60-40d227ff895e tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Getting quotas for user 14da69798e344e70ba64bf8187523e45 and project 959c5c84bd724d2688f435b15b41f1c8. Resources: {'instances', 'cores', 'ram'} {{(pid=120471) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 13:35:37.439916 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-81eafd50-70ad-4a8b-8b60-40d227ff895e tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Going to run 1 instances... {{(pid=120471) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 13:35:37.442351 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-81eafd50-70ad-4a8b-8b60-40d227ff895e tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 8ea882c7-9191-4712-91eb-a810e49b9e52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9beb860d-9c3f-4244-80aa-71a9c337a429',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120471) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 13:35:37.490818 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-81eafd50-70ad-4a8b-8b60-40d227ff895e tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.619998 May 19 13:35:37.491471 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 285/552] 10.222.0.24 () {62 vars in 1187 bytes} [Thu May 19 13:35:36 2022] POST /compute/v2.1/servers => generated 402 bytes in 622 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 19 13:35:37.504364 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-8cf75a8d-3361-4fb6-b31a-c5782af3b203 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:37.505390 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-8cf75a8d-3361-4fb6-b31a-c5782af3b203 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 8ea882c7-9191-4712-91eb-a810e49b9e52] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:37.572143 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-8cf75a8d-3361-4fb6-b31a-c5782af3b203 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:37.581066 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-8cf75a8d-3361-4fb6-b31a-c5782af3b203 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:37.582772 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-8cf75a8d-3361-4fb6-b31a-c5782af3b203 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:37.584303 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-8cf75a8d-3361-4fb6-b31a-c5782af3b203 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52" status: 200 len: 1280 microversion: 2.20 time: 0.085799 May 19 13:35:37.585184 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 268/553] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:35:37 2022] GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52 => generated 1280 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:35:37.768276 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-85df3dd8-33db-4ff0-b0b8-50c246a9e345 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:37.768993 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-85df3dd8-33db-4ff0-b0b8-50c246a9e345 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: 8a3b02c0-6943-45dc-9086-16ff29536118] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:37.776162 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-85df3dd8-33db-4ff0-b0b8-50c246a9e345 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:37.777235 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-85df3dd8-33db-4ff0-b0b8-50c246a9e345 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:37.778079 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-85df3dd8-33db-4ff0-b0b8-50c246a9e345 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:37.778510 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-85df3dd8-33db-4ff0-b0b8-50c246a9e345 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:37.919167 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-85df3dd8-33db-4ff0-b0b8-50c246a9e345 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:37.927950 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-85df3dd8-33db-4ff0-b0b8-50c246a9e345 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118" status: 200 len: 1713 microversion: 2.1 time: 0.163653 May 19 13:35:37.928540 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 286/554] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:35:37 2022] GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118 => generated 1713 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:35:38.038826 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-91315f08-fea2-47a3-8e85-5cf36e88908e tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:38.039378 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-91315f08-fea2-47a3-8e85-5cf36e88908e tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: 8a3b02c0-6943-45dc-9086-16ff29536118] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:38.049072 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-91315f08-fea2-47a3-8e85-5cf36e88908e tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:38.049558 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-91315f08-fea2-47a3-8e85-5cf36e88908e tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:38.050337 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-91315f08-fea2-47a3-8e85-5cf36e88908e tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:38.050770 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-91315f08-fea2-47a3-8e85-5cf36e88908e tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:38.143109 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.wsgi [None req-91315f08-fea2-47a3-8e85-5cf36e88908e tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] HTTP exception thrown: Cannot 'detach_volume' instance 8a3b02c0-6943-45dc-9086-16ff29536118 while it is in vm_state rescued May 19 13:35:38.144736 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-91315f08-fea2-47a3-8e85-5cf36e88908e tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Request method failure captured: May 19 13:35:38.144736 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: request: DELETE /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118/os-volume_attachments/1fd6b6b4-1ff0-45c4-a900-1a2bfa30a3d4 HTTP/1.1 May 19 13:35:38.144736 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Accept: application/json May 19 13:35:38.144736 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Accept-Encoding: identity May 19 13:35:38.144736 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Connection: close May 19 13:35:38.144736 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Content-Length: 0 May 19 13:35:38.144736 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Content-Type: application/json May 19 13:35:38.144736 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Host: 10.222.0.24 May 19 13:35:38.144736 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Openstack-System-Scope: None May 19 13:35:38.144736 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: User-Agent: python-urllib3/1.26.9 May 19 13:35:38.144736 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Auth-Token: gAAAAABihka28w_XrUfaOtaJo3uOu_VKP25qoARCt1sMNKJyTv9Zs2UdBFAMxpQQTuZSPm5_OGrEsu9-FHYT7rVvy0PjGuvfYySPIV0FbQR2CrL-a-e1bGrkGoxusbmks-C9euLBSRZS_Ru4AaJkLiaaCt15rraZYv-Ku8n3RqspqC_JYm_SeyE May 19 13:35:38.144736 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Domain-Id: None May 19 13:35:38.144736 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Domain-Name: None May 19 13:35:38.144736 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Identity-Status: Confirmed May 19 13:35:38.144736 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Is-Admin-Project: True May 19 13:35:38.144736 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Domain-Id: default May 19 13:35:38.144736 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Domain-Name: Default May 19 13:35:38.144736 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Id: 63972a518bb048d19dd070eb9ac85445 May 19 13:35:38.144736 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-217359763 May 19 13:35:38.144736 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Role: reader,member May 19 13:35:38.144736 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Roles: reader,member May 19 13:35:38.146387 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/63972a518bb048d19dd070eb9ac85445"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/63972a518bb048d19dd070eb9ac85445"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_63972a518bb048d19dd070eb9ac85445", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/63972a518bb048d19dd070eb9ac85445"}]}] May 19 13:35:38.146387 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant: tempest-ServerRescueNegativeTestJSON-217359763 May 19 13:35:38.146387 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant-Id: 63972a518bb048d19dd070eb9ac85445 May 19 13:35:38.146387 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-217359763 May 19 13:35:38.146387 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User: tempest-ServerRescueNegativeTestJSON-217359763-project May 19 13:35:38.146387 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Domain-Id: default May 19 13:35:38.146387 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Domain-Name: Default May 19 13:35:38.146387 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Id: 2d3b91bfd0304cc793e3ad52c9b9e865 May 19 13:35:38.146387 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Name: tempest-ServerRescueNegativeTestJSON-217359763-project May 19 13:35:38.146387 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: method: > May 19 13:35:38.146387 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: exception: Cannot 'detach_volume' instance 8a3b02c0-6943-45dc-9086-16ff29536118 while it is in vm_state rescued May 19 13:35:38.147133 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: action_args: {'server_id': '8a3b02c0-6943-45dc-9086-16ff29536118', 'id': '1fd6b6b4-1ff0-45c4-a900-1a2bfa30a3d4'} May 19 13:35:38.147133 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:35:38.147133 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:35:38.147133 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 19 13:35:38.147133 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 19 13:35:38.147133 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 19 13:35:38.147133 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 13:35:38.147133 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 19 13:35:38.147133 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 19 13:35:38.147133 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8a3b02c0-6943-45dc-9086-16ff29536118 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 19 13:35:38.147133 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:35:38.147133 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:35:38.147133 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:35:38.147133 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:35:38.147133 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:35:38.147133 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:35:38.147133 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:35:38.147133 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:35:38.147133 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:35:38.147133 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:35:38.148311 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 19 13:35:38.148311 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 19 13:35:38.148311 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 19 13:35:38.148311 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 19 13:35:38.148311 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 8a3b02c0-6943-45dc-9086-16ff29536118 while it is in vm_state rescued May 19 13:35:38.148311 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:35:38.148311 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:35:38.148311 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:35:38.148311 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:35:38.148311 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:35:38.148311 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:35:38.148311 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:35:38.148311 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:35:38.148311 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 8a3b02c0-6943-45dc-9086-16ff29536118 while it is in vm_state rescued May 19 13:35:38.148311 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:35:38.148311 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-91315f08-fea2-47a3-8e85-5cf36e88908e tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Returning 409 to user: Cannot 'detach_volume' instance 8a3b02c0-6943-45dc-9086-16ff29536118 while it is in vm_state rescued {{(pid=120472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:35:38.149294 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-91315f08-fea2-47a3-8e85-5cf36e88908e tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "DELETE /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118/os-volume_attachments/1fd6b6b4-1ff0-45c4-a900-1a2bfa30a3d4" status: 409 len: 152 microversion: 2.1 time: 0.111414 May 19 13:35:38.149294 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 269/555] 10.222.0.24 () {58 vars in 1415 bytes} [Thu May 19 13:35:38 2022] DELETE /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118/os-volume_attachments/1fd6b6b4-1ff0-45c4-a900-1a2bfa30a3d4 => generated 152 bytes in 113 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 19 13:35:38.155918 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-f0330065-26b6-4ccd-b378-8b8a201e3644 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:35:38.156530 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-f0330065-26b6-4ccd-b378-8b8a201e3644 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: 8a3b02c0-6943-45dc-9086-16ff29536118] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:38.163137 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-f0330065-26b6-4ccd-b378-8b8a201e3644 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:38.163638 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-f0330065-26b6-4ccd-b378-8b8a201e3644 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:38.164386 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-f0330065-26b6-4ccd-b378-8b8a201e3644 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:38.164811 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-f0330065-26b6-4ccd-b378-8b8a201e3644 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:38.236753 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-f0330065-26b6-4ccd-b378-8b8a201e3644 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "POST /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118/action" status: 202 len: 0 microversion: 2.1 time: 0.084977 May 19 13:35:38.237368 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 287/556] 10.222.0.24 () {60 vars in 1277 bytes} [Thu May 19 13:35:38 2022] POST /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 13:35:38.239903 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-a0c0540d-e67f-4c8e-9c71-be16e1f16ba0 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:38.240915 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-a0c0540d-e67f-4c8e-9c71-be16e1f16ba0 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] [instance: 7c295eb7-8e9f-436b-8e36-05adc8fbfcf4] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:38.247793 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-a0c0540d-e67f-4c8e-9c71-be16e1f16ba0 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:38.248277 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-a0c0540d-e67f-4c8e-9c71-be16e1f16ba0 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:38.248651 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-b8e8e5a8-6d54-4f19-af9a-6032d2065435 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:38.249063 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-a0c0540d-e67f-4c8e-9c71-be16e1f16ba0 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:38.249342 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-b8e8e5a8-6d54-4f19-af9a-6032d2065435 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: 8a3b02c0-6943-45dc-9086-16ff29536118] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:38.249511 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-a0c0540d-e67f-4c8e-9c71-be16e1f16ba0 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:38.255851 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-b8e8e5a8-6d54-4f19-af9a-6032d2065435 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:38.256306 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-b8e8e5a8-6d54-4f19-af9a-6032d2065435 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:38.257078 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-b8e8e5a8-6d54-4f19-af9a-6032d2065435 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:38.257530 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-b8e8e5a8-6d54-4f19-af9a-6032d2065435 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:38.287818 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-a0c0540d-e67f-4c8e-9c71-be16e1f16ba0 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:38.288290 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-a0c0540d-e67f-4c8e-9c71-be16e1f16ba0 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:38.288734 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.objects.instance [None req-a0c0540d-e67f-4c8e-9c71-be16e1f16ba0 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lazy-loading 'fault' on Instance uuid 7c295eb7-8e9f-436b-8e36-05adc8fbfcf4 {{(pid=120472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 13:35:38.346177 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-a0c0540d-e67f-4c8e-9c71-be16e1f16ba0 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26c50b54171491b987ca844091c6e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96a605108ec47a081c60bc8dc16fd8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:38.357947 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-a0c0540d-e67f-4c8e-9c71-be16e1f16ba0 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] 10.222.0.24 "GET /compute/v2.1/servers/7c295eb7-8e9f-436b-8e36-05adc8fbfcf4" status: 200 len: 1307 microversion: 2.1 time: 0.121994 May 19 13:35:38.359350 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 270/557] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:35:38 2022] GET /compute/v2.1/servers/7c295eb7-8e9f-436b-8e36-05adc8fbfcf4 => generated 1307 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:35:38.397988 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-b8e8e5a8-6d54-4f19-af9a-6032d2065435 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:38.407556 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-b8e8e5a8-6d54-4f19-af9a-6032d2065435 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118" status: 200 len: 1721 microversion: 2.1 time: 0.163814 May 19 13:35:38.408774 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 288/558] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:35:38 2022] GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:35:38.606094 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-4349cff5-6d2c-4e66-811c-ba0f660d1c7d tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:38.606917 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-4349cff5-6d2c-4e66-811c-ba0f660d1c7d tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 8ea882c7-9191-4712-91eb-a810e49b9e52] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:38.618360 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-4349cff5-6d2c-4e66-811c-ba0f660d1c7d tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:38.619097 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-4349cff5-6d2c-4e66-811c-ba0f660d1c7d tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:38.620384 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-4349cff5-6d2c-4e66-811c-ba0f660d1c7d tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:38.620851 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-4349cff5-6d2c-4e66-811c-ba0f660d1c7d tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:38.688104 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-4349cff5-6d2c-4e66-811c-ba0f660d1c7d tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:38.696083 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-4349cff5-6d2c-4e66-811c-ba0f660d1c7d tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:38.697738 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-4349cff5-6d2c-4e66-811c-ba0f660d1c7d tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:38.698711 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-4349cff5-6d2c-4e66-811c-ba0f660d1c7d tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52" status: 200 len: 1332 microversion: 2.20 time: 0.099090 May 19 13:35:38.699284 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 271/559] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:35:38 2022] GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52 => generated 1332 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:35:39.375922 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-37b9b210-9c5a-4497-b7df-dc6316a39984 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:39.376524 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-37b9b210-9c5a-4497-b7df-dc6316a39984 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] [instance: 7c295eb7-8e9f-436b-8e36-05adc8fbfcf4] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:39.383448 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-37b9b210-9c5a-4497-b7df-dc6316a39984 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:39.383924 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-37b9b210-9c5a-4497-b7df-dc6316a39984 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:39.384659 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-37b9b210-9c5a-4497-b7df-dc6316a39984 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:39.385102 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-37b9b210-9c5a-4497-b7df-dc6316a39984 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:39.402643 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.wsgi [None req-37b9b210-9c5a-4497-b7df-dc6316a39984 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] HTTP exception thrown: Instance 7c295eb7-8e9f-436b-8e36-05adc8fbfcf4 could not be found. May 19 13:35:39.404697 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-37b9b210-9c5a-4497-b7df-dc6316a39984 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Request method failure captured: May 19 13:35:39.404697 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: request: GET /compute/v2.1/servers/7c295eb7-8e9f-436b-8e36-05adc8fbfcf4 HTTP/1.1 May 19 13:35:39.404697 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Accept: application/json May 19 13:35:39.404697 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Accept-Encoding: identity May 19 13:35:39.404697 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Connection: close May 19 13:35:39.404697 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Content-Length: 0 May 19 13:35:39.404697 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Content-Type: application/json May 19 13:35:39.404697 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Host: 10.222.0.24 May 19 13:35:39.404697 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Openstack-System-Scope: None May 19 13:35:39.404697 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: User-Agent: python-urllib3/1.26.9 May 19 13:35:39.404697 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Auth-Token: gAAAAABihkciErpGRGTHy_HC9rB31uaIJ1ZcY901_HZKXf-8Zb6lTyuEBcTJQMduhkNA2CJRaXG1Xm3s0YizpoqVto4oCnqG2L99_spROU9YmWHfqURHFtMGfDHMYJpZe63JHkiyz762OrL-uJyC9BluYu8s4IhovxCjhAZjOStieyYBHwZvAeU May 19 13:35:39.404697 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Domain-Id: None May 19 13:35:39.404697 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Domain-Name: None May 19 13:35:39.404697 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Identity-Status: Confirmed May 19 13:35:39.404697 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Is-Admin-Project: True May 19 13:35:39.404697 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Domain-Id: default May 19 13:35:39.404697 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Domain-Name: Default May 19 13:35:39.404697 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Id: c96a605108ec47a081c60bc8dc16fd8e May 19 13:35:39.404697 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Name: tempest-VolumesSnapshotTestJSON-908856571 May 19 13:35:39.404697 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Role: reader,member May 19 13:35:39.404697 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Roles: reader,member May 19 13:35:39.406275 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/c96a605108ec47a081c60bc8dc16fd8e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/c96a605108ec47a081c60bc8dc16fd8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_c96a605108ec47a081c60bc8dc16fd8e", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/c96a605108ec47a081c60bc8dc16fd8e"}]}] May 19 13:35:39.406275 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Tenant: tempest-VolumesSnapshotTestJSON-908856571 May 19 13:35:39.406275 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Tenant-Id: c96a605108ec47a081c60bc8dc16fd8e May 19 13:35:39.406275 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-908856571 May 19 13:35:39.406275 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User: tempest-VolumesSnapshotTestJSON-908856571-project May 19 13:35:39.406275 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Domain-Id: default May 19 13:35:39.406275 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Domain-Name: Default May 19 13:35:39.406275 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Id: d26c50b54171491b987ca844091c6e73 May 19 13:35:39.406275 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Name: tempest-VolumesSnapshotTestJSON-908856571-project May 19 13:35:39.406275 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: method: > May 19 13:35:39.406275 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: exception: Instance 7c295eb7-8e9f-436b-8e36-05adc8fbfcf4 could not be found. May 19 13:35:39.406275 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: action_args: {'id': '7c295eb7-8e9f-436b-8e36-05adc8fbfcf4'} May 19 13:35:39.407084 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:35:39.407084 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:35:39.407084 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 13:35:39.407084 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 13:35:39.407084 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 13:35:39.407084 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 13:35:39.407084 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 13:35:39.407084 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 13:35:39.407084 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 13:35:39.407084 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 13:35:39.407084 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c295eb7-8e9f-436b-8e36-05adc8fbfcf4 could not be found. May 19 13:35:39.407084 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:35:39.407084 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:35:39.407084 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:35:39.407084 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:35:39.407084 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:35:39.407084 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:35:39.407084 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:35:39.407084 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:35:39.407084 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:35:39.408732 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:35:39.408732 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 13:35:39.408732 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 13:35:39.408732 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 13:35:39.408732 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 13:35:39.408732 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 13:35:39.408732 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 13:35:39.408732 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c295eb7-8e9f-436b-8e36-05adc8fbfcf4 could not be found. May 19 13:35:39.408732 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:35:39.408732 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:35:39.408732 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:35:39.408732 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:35:39.408732 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:35:39.408732 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:35:39.408732 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:35:39.408732 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:35:39.408732 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c295eb7-8e9f-436b-8e36-05adc8fbfcf4 could not be found. May 19 13:35:39.408732 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:35:39.409932 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-37b9b210-9c5a-4497-b7df-dc6316a39984 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] Returning 404 to user: Instance 7c295eb7-8e9f-436b-8e36-05adc8fbfcf4 could not be found. {{(pid=120471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:35:39.409932 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-37b9b210-9c5a-4497-b7df-dc6316a39984 tempest-VolumesSnapshotTestJSON-908856571 tempest-VolumesSnapshotTestJSON-908856571-project] 10.222.0.24 "GET /compute/v2.1/servers/7c295eb7-8e9f-436b-8e36-05adc8fbfcf4" status: 404 len: 111 microversion: 2.1 time: 0.034236 May 19 13:35:39.410081 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 289/560] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:35:39 2022] GET /compute/v2.1/servers/7c295eb7-8e9f-436b-8e36-05adc8fbfcf4 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 13:35:39.426257 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-d9c0d29c-3033-4543-8cb1-30d451dc867d tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:39.426870 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-d9c0d29c-3033-4543-8cb1-30d451dc867d tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: 8a3b02c0-6943-45dc-9086-16ff29536118] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:39.434072 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-d9c0d29c-3033-4543-8cb1-30d451dc867d tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:39.434519 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-d9c0d29c-3033-4543-8cb1-30d451dc867d tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:39.435614 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-d9c0d29c-3033-4543-8cb1-30d451dc867d tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:39.436419 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-d9c0d29c-3033-4543-8cb1-30d451dc867d tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:39.694082 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-d9c0d29c-3033-4543-8cb1-30d451dc867d tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:39.705185 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-d9c0d29c-3033-4543-8cb1-30d451dc867d tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118" status: 200 len: 1721 microversion: 2.1 time: 0.283098 May 19 13:35:39.705894 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 272/561] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:35:39 2022] GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118 => generated 1721 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:35:39.716177 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-ae805602-4e60-4534-92a3-e8f48f1e5dbd tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:39.716857 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-ae805602-4e60-4534-92a3-e8f48f1e5dbd tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 8ea882c7-9191-4712-91eb-a810e49b9e52] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:39.725172 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-ae805602-4e60-4534-92a3-e8f48f1e5dbd tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:39.726103 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-ae805602-4e60-4534-92a3-e8f48f1e5dbd tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:39.727276 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-ae805602-4e60-4534-92a3-e8f48f1e5dbd tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:39.727764 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-ae805602-4e60-4534-92a3-e8f48f1e5dbd tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:39.878545 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-ae805602-4e60-4534-92a3-e8f48f1e5dbd tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:39.887898 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-ae805602-4e60-4534-92a3-e8f48f1e5dbd tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:39.889509 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-ae805602-4e60-4534-92a3-e8f48f1e5dbd tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:39.890599 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-ae805602-4e60-4534-92a3-e8f48f1e5dbd tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52" status: 200 len: 1406 microversion: 2.20 time: 0.178471 May 19 13:35:39.891149 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 290/562] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:35:39 2022] GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52 => generated 1406 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 13:35:40.728047 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-10cc465e-216c-40a9-8da7-95d5613e3daa tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:40.728047 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-10cc465e-216c-40a9-8da7-95d5613e3daa tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: 8a3b02c0-6943-45dc-9086-16ff29536118] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:40.730856 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:35:40.736196 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-10cc465e-216c-40a9-8da7-95d5613e3daa tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:40.736645 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-10cc465e-216c-40a9-8da7-95d5613e3daa tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:40.737580 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-10cc465e-216c-40a9-8da7-95d5613e3daa tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:40.737831 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-10cc465e-216c-40a9-8da7-95d5613e3daa tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:40.908898 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-5a849d1d-4d6d-4830-9a13-b752d6baebd6 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:40.911117 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-5a849d1d-4d6d-4830-9a13-b752d6baebd6 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 8ea882c7-9191-4712-91eb-a810e49b9e52] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:40.918147 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-5a849d1d-4d6d-4830-9a13-b752d6baebd6 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:40.919152 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-5a849d1d-4d6d-4830-9a13-b752d6baebd6 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:40.920799 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-5a849d1d-4d6d-4830-9a13-b752d6baebd6 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:40.922065 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-5a849d1d-4d6d-4830-9a13-b752d6baebd6 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:40.959176 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-10cc465e-216c-40a9-8da7-95d5613e3daa tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:40.969877 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-10cc465e-216c-40a9-8da7-95d5613e3daa tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118" status: 200 len: 1721 microversion: 2.1 time: 0.249304 May 19 13:35:40.981319 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 273/563] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:35:40 2022] GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118 => generated 1721 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:35:41.074547 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-5a849d1d-4d6d-4830-9a13-b752d6baebd6 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:41.084056 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-5a849d1d-4d6d-4830-9a13-b752d6baebd6 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:41.085711 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-5a849d1d-4d6d-4830-9a13-b752d6baebd6 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:41.086812 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-5a849d1d-4d6d-4830-9a13-b752d6baebd6 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52" status: 200 len: 1406 microversion: 2.20 time: 0.181870 May 19 13:35:41.087359 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 291/564] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:35:40 2022] GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52 => generated 1406 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:35:41.500861 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [req-3cb328fd-1dea-48b8-b761-9c3683119dc6 req-9edd7482-6dc6-4f90-9294-e20ab42838a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ea882c7-9191-4712-91eb-a810e49b9e52", "tag": "23d6a89e-f532-421c-8c67-0672e13b68a3"}]} {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:35:41.513385 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [req-3cb328fd-1dea-48b8-b761-9c3683119dc6 req-9edd7482-6dc6-4f90-9294-e20ab42838a1 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:41.514307 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [req-3cb328fd-1dea-48b8-b761-9c3683119dc6 req-9edd7482-6dc6-4f90-9294-e20ab42838a1 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:41.527010 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.compute.server_external_events [req-3cb328fd-1dea-48b8-b761-9c3683119dc6 req-9edd7482-6dc6-4f90-9294-e20ab42838a1 service nova] Creating event network-changed:23d6a89e-f532-421c-8c67-0672e13b68a3 for instance 8ea882c7-9191-4712-91eb-a810e49b9e52 on hv-cinder-84112 May 19 13:35:41.532384 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [req-3cb328fd-1dea-48b8-b761-9c3683119dc6 req-9edd7482-6dc6-4f90-9294-e20ab42838a1 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037546 May 19 13:35:41.533014 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 274/565] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:35:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:35:41.988244 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-5d6171e8-0033-4b10-b1c2-40510e1a7cde tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:41.988843 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-5d6171e8-0033-4b10-b1c2-40510e1a7cde tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: 8a3b02c0-6943-45dc-9086-16ff29536118] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:41.996174 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-5d6171e8-0033-4b10-b1c2-40510e1a7cde tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:41.996625 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-5d6171e8-0033-4b10-b1c2-40510e1a7cde tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:41.997390 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-5d6171e8-0033-4b10-b1c2-40510e1a7cde tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:41.997857 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-5d6171e8-0033-4b10-b1c2-40510e1a7cde tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:42.106871 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-ef31c281-ea42-4fa2-aa50-40103612ab56 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:42.107549 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-ef31c281-ea42-4fa2-aa50-40103612ab56 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 8ea882c7-9191-4712-91eb-a810e49b9e52] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:42.114143 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-ef31c281-ea42-4fa2-aa50-40103612ab56 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:42.114592 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-ef31c281-ea42-4fa2-aa50-40103612ab56 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:42.115357 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-ef31c281-ea42-4fa2-aa50-40103612ab56 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:42.115796 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-ef31c281-ea42-4fa2-aa50-40103612ab56 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:42.135250 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-5d6171e8-0033-4b10-b1c2-40510e1a7cde tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:42.143388 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-5d6171e8-0033-4b10-b1c2-40510e1a7cde tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118" status: 200 len: 1727 microversion: 2.1 time: 0.158998 May 19 13:35:42.143959 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 292/566] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:35:41 2022] GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118 => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:35:42.160108 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-70a5e31f-5611-4ac2-8433-4b59e58b0089 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:42.160739 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-70a5e31f-5611-4ac2-8433-4b59e58b0089 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: 8a3b02c0-6943-45dc-9086-16ff29536118] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:42.168296 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-70a5e31f-5611-4ac2-8433-4b59e58b0089 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:42.169223 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-70a5e31f-5611-4ac2-8433-4b59e58b0089 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:42.170026 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-70a5e31f-5611-4ac2-8433-4b59e58b0089 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:42.170602 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-70a5e31f-5611-4ac2-8433-4b59e58b0089 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:42.266884 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-70a5e31f-5611-4ac2-8433-4b59e58b0089 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.110688 May 19 13:35:42.267886 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 293/567] 10.222.0.24 () {58 vars in 1274 bytes} [Thu May 19 13:35:42 2022] GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118/os-interface => generated 284 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:35:42.272568 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-ef31c281-ea42-4fa2-aa50-40103612ab56 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:42.286085 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-ef31c281-ea42-4fa2-aa50-40103612ab56 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:42.288505 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-ef31c281-ea42-4fa2-aa50-40103612ab56 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:42.290323 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-ef31c281-ea42-4fa2-aa50-40103612ab56 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52" status: 200 len: 1406 microversion: 2.20 time: 0.188427 May 19 13:35:42.291156 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 275/568] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:35:42 2022] GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52 => generated 1406 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:35:43.312737 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-3ba23c62-9be8-4847-8d2f-7136cdaf9516 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:43.313448 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-3ba23c62-9be8-4847-8d2f-7136cdaf9516 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 8ea882c7-9191-4712-91eb-a810e49b9e52] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:43.320028 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-3ba23c62-9be8-4847-8d2f-7136cdaf9516 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:43.320473 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-3ba23c62-9be8-4847-8d2f-7136cdaf9516 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:43.321240 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-3ba23c62-9be8-4847-8d2f-7136cdaf9516 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:43.321717 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-3ba23c62-9be8-4847-8d2f-7136cdaf9516 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:43.454532 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-3ba23c62-9be8-4847-8d2f-7136cdaf9516 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:43.463218 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-3ba23c62-9be8-4847-8d2f-7136cdaf9516 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:43.464984 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-3ba23c62-9be8-4847-8d2f-7136cdaf9516 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:43.466133 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-3ba23c62-9be8-4847-8d2f-7136cdaf9516 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52" status: 200 len: 1406 microversion: 2.20 time: 0.157979 May 19 13:35:43.466722 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 294/569] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:35:43 2022] GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52 => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:35:43.548550 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [req-79f74bc9-5fb7-48f5-af04-38650a3812bb req-5ffb412b-a3de-483f-9967-e2a13e030a14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a3b02c0-6943-45dc-9086-16ff29536118", "tag": "3d603fe2-3873-40ee-9c1d-9815f7c92788"}, {"name": "network-changed", "server_uuid": "8a3b02c0-6943-45dc-9086-16ff29536118", "tag": "3d603fe2-3873-40ee-9c1d-9815f7c92788"}]} {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:35:43.558053 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [req-79f74bc9-5fb7-48f5-af04-38650a3812bb req-5ffb412b-a3de-483f-9967-e2a13e030a14 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:43.558498 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [req-79f74bc9-5fb7-48f5-af04-38650a3812bb req-5ffb412b-a3de-483f-9967-e2a13e030a14 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:43.578347 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.compute.server_external_events [req-79f74bc9-5fb7-48f5-af04-38650a3812bb req-5ffb412b-a3de-483f-9967-e2a13e030a14 service nova] Creating event network-changed:3d603fe2-3873-40ee-9c1d-9815f7c92788 for instance 8a3b02c0-6943-45dc-9086-16ff29536118 on hv-cinder-84112 May 19 13:35:43.578809 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.compute.server_external_events [req-79f74bc9-5fb7-48f5-af04-38650a3812bb req-5ffb412b-a3de-483f-9967-e2a13e030a14 service nova] Creating event network-changed:3d603fe2-3873-40ee-9c1d-9815f7c92788 for instance 8a3b02c0-6943-45dc-9086-16ff29536118 on hv-cinder-84112 May 19 13:35:43.584382 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [req-79f74bc9-5fb7-48f5-af04-38650a3812bb req-5ffb412b-a3de-483f-9967-e2a13e030a14 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.039658 May 19 13:35:43.584987 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 276/570] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:35:43 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:35:44.486696 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-7132a4ae-fc18-4264-8a73-441d0a744de0 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:44.493082 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-7132a4ae-fc18-4264-8a73-441d0a744de0 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 8ea882c7-9191-4712-91eb-a810e49b9e52] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:44.502463 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-7132a4ae-fc18-4264-8a73-441d0a744de0 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:44.503251 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-7132a4ae-fc18-4264-8a73-441d0a744de0 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:44.504189 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-7132a4ae-fc18-4264-8a73-441d0a744de0 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:44.504771 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-7132a4ae-fc18-4264-8a73-441d0a744de0 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:44.931446 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-7132a4ae-fc18-4264-8a73-441d0a744de0 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:44.940546 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-7132a4ae-fc18-4264-8a73-441d0a744de0 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:44.942158 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-7132a4ae-fc18-4264-8a73-441d0a744de0 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:44.943299 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-7132a4ae-fc18-4264-8a73-441d0a744de0 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52" status: 200 len: 1406 microversion: 2.20 time: 0.462420 May 19 13:35:44.943928 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 295/571] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:35:44 2022] GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52 => generated 1406 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:35:45.963766 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-2d2bdc0b-4631-4b7c-926c-ed9a5dc5ef7e tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:45.964613 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-2d2bdc0b-4631-4b7c-926c-ed9a5dc5ef7e tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 8ea882c7-9191-4712-91eb-a810e49b9e52] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:45.970810 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-2d2bdc0b-4631-4b7c-926c-ed9a5dc5ef7e tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:45.971236 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-2d2bdc0b-4631-4b7c-926c-ed9a5dc5ef7e tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:45.971992 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-2d2bdc0b-4631-4b7c-926c-ed9a5dc5ef7e tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:45.972411 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-2d2bdc0b-4631-4b7c-926c-ed9a5dc5ef7e tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:46.108009 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-2d2bdc0b-4631-4b7c-926c-ed9a5dc5ef7e tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:46.116073 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-2d2bdc0b-4631-4b7c-926c-ed9a5dc5ef7e tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:46.117577 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-2d2bdc0b-4631-4b7c-926c-ed9a5dc5ef7e tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:46.118649 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-2d2bdc0b-4631-4b7c-926c-ed9a5dc5ef7e tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52" status: 200 len: 1406 microversion: 2.20 time: 0.159919 May 19 13:35:46.119206 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 277/572] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:35:45 2022] GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 13:35:47.139915 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-232b1999-62a5-4e6b-8403-73d589d1b33f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:47.140508 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-232b1999-62a5-4e6b-8403-73d589d1b33f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 8ea882c7-9191-4712-91eb-a810e49b9e52] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:47.148867 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-232b1999-62a5-4e6b-8403-73d589d1b33f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:47.149466 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-232b1999-62a5-4e6b-8403-73d589d1b33f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:47.150269 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-232b1999-62a5-4e6b-8403-73d589d1b33f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:47.150703 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-232b1999-62a5-4e6b-8403-73d589d1b33f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:47.297269 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-232b1999-62a5-4e6b-8403-73d589d1b33f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:47.305868 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-232b1999-62a5-4e6b-8403-73d589d1b33f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:47.307945 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-232b1999-62a5-4e6b-8403-73d589d1b33f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:47.309032 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-232b1999-62a5-4e6b-8403-73d589d1b33f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52" status: 200 len: 1406 microversion: 2.20 time: 0.175022 May 19 13:35:47.309645 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 296/573] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:35:47 2022] GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52 => generated 1406 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:35:48.327643 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-baf4c2bd-27e2-4f1f-bbfb-fe0d3745039d tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:48.328225 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-baf4c2bd-27e2-4f1f-bbfb-fe0d3745039d tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 8ea882c7-9191-4712-91eb-a810e49b9e52] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:48.330778 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_cell0:SELECT=2 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:35:48.336729 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-baf4c2bd-27e2-4f1f-bbfb-fe0d3745039d tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:48.337176 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-baf4c2bd-27e2-4f1f-bbfb-fe0d3745039d tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:48.337964 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-baf4c2bd-27e2-4f1f-bbfb-fe0d3745039d tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:48.338395 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-baf4c2bd-27e2-4f1f-bbfb-fe0d3745039d tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:48.487183 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-baf4c2bd-27e2-4f1f-bbfb-fe0d3745039d tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:48.495370 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-baf4c2bd-27e2-4f1f-bbfb-fe0d3745039d tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:48.496874 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-baf4c2bd-27e2-4f1f-bbfb-fe0d3745039d tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:48.498011 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-baf4c2bd-27e2-4f1f-bbfb-fe0d3745039d tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52" status: 200 len: 1406 microversion: 2.20 time: 0.174833 May 19 13:35:48.498541 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 278/574] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:35:48 2022] GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52 => generated 1406 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:35:49.520442 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-ea70ef7b-243b-472f-9446-5edd6d133412 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:49.521070 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-ea70ef7b-243b-472f-9446-5edd6d133412 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 8ea882c7-9191-4712-91eb-a810e49b9e52] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:49.523025 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_cell0:SELECT=2 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:35:49.523721 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_cell0:SELECT=10 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:35:49.531262 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-ea70ef7b-243b-472f-9446-5edd6d133412 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:49.531698 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-ea70ef7b-243b-472f-9446-5edd6d133412 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:49.532458 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-ea70ef7b-243b-472f-9446-5edd6d133412 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:49.532882 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-ea70ef7b-243b-472f-9446-5edd6d133412 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:49.665071 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-ea70ef7b-243b-472f-9446-5edd6d133412 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:49.673932 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-ea70ef7b-243b-472f-9446-5edd6d133412 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:49.675419 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-ea70ef7b-243b-472f-9446-5edd6d133412 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:49.676508 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-ea70ef7b-243b-472f-9446-5edd6d133412 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52" status: 200 len: 1406 microversion: 2.20 time: 0.160023 May 19 13:35:49.677068 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 297/575] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:35:49 2022] GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:35:50.698759 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-f2e56e83-a865-4a45-b8b3-bae67386d9d5 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:50.699743 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-f2e56e83-a865-4a45-b8b3-bae67386d9d5 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 8ea882c7-9191-4712-91eb-a810e49b9e52] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:50.711057 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-f2e56e83-a865-4a45-b8b3-bae67386d9d5 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:50.711791 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-f2e56e83-a865-4a45-b8b3-bae67386d9d5 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:50.713023 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-f2e56e83-a865-4a45-b8b3-bae67386d9d5 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:50.713875 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-f2e56e83-a865-4a45-b8b3-bae67386d9d5 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:50.853908 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-f2e56e83-a865-4a45-b8b3-bae67386d9d5 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:50.865902 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-f2e56e83-a865-4a45-b8b3-bae67386d9d5 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:50.868212 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-f2e56e83-a865-4a45-b8b3-bae67386d9d5 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:50.870062 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-f2e56e83-a865-4a45-b8b3-bae67386d9d5 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52" status: 200 len: 1406 microversion: 2.20 time: 0.177563 May 19 13:35:50.870623 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 279/576] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:35:50 2022] GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52 => generated 1406 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:35:51.132629 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-befee4b0-5f58-4565-bc27-126bef80c301 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1594261357"}} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:35:51.133244 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-befee4b0-5f58-4565-bc27-126bef80c301 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] [instance: c97e472c-540e-4bd5-abaf-d7dadac8c6be] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:51.140363 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-befee4b0-5f58-4565-bc27-126bef80c301 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:51.140803 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-befee4b0-5f58-4565-bc27-126bef80c301 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:51.141585 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-befee4b0-5f58-4565-bc27-126bef80c301 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:51.142026 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-befee4b0-5f58-4565-bc27-126bef80c301 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:51.279442 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.network.security_group_api [None req-befee4b0-5f58-4565-bc27-126bef80c301 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Removing security group aecfda95-6538-4bd0-ae3e-18f1d8f9a9b8 from port 97ed1b45-3101-4569-a101-5346f9044405 May 19 13:35:51.688099 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-befee4b0-5f58-4565-bc27-126bef80c301 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] 10.222.0.24 "POST /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be/action" status: 202 len: 0 microversion: 2.1 time: 0.559490 May 19 13:35:51.689048 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 298/577] 10.222.0.24 () {60 vars in 1277 bytes} [Thu May 19 13:35:51 2022] POST /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be/action => generated 0 bytes in 561 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 13:35:51.703998 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [req-50e8620a-5622-4811-89aa-b0921b32f66a req-22cf73bb-3c66-4da0-b63f-e9d151b83ef4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c97e472c-540e-4bd5-abaf-d7dadac8c6be", "tag": "97ed1b45-3101-4569-a101-5346f9044405"}]} {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:35:51.713195 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [req-50e8620a-5622-4811-89aa-b0921b32f66a req-22cf73bb-3c66-4da0-b63f-e9d151b83ef4 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:51.713912 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [req-50e8620a-5622-4811-89aa-b0921b32f66a req-22cf73bb-3c66-4da0-b63f-e9d151b83ef4 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:51.750838 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.compute.server_external_events [req-50e8620a-5622-4811-89aa-b0921b32f66a req-22cf73bb-3c66-4da0-b63f-e9d151b83ef4 service nova] Creating event network-changed:97ed1b45-3101-4569-a101-5346f9044405 for instance c97e472c-540e-4bd5-abaf-d7dadac8c6be on hv-cinder-84112 May 19 13:35:51.758381 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [req-50e8620a-5622-4811-89aa-b0921b32f66a req-22cf73bb-3c66-4da0-b63f-e9d151b83ef4 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058861 May 19 13:35:51.759307 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 280/578] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:35:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:35:51.889208 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-e78fea63-855b-4c96-975a-54f607f4f0ea tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:51.889976 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-e78fea63-855b-4c96-975a-54f607f4f0ea tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 8ea882c7-9191-4712-91eb-a810e49b9e52] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:51.897140 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-e78fea63-855b-4c96-975a-54f607f4f0ea tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:51.897993 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-e78fea63-855b-4c96-975a-54f607f4f0ea tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:51.899031 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-e78fea63-855b-4c96-975a-54f607f4f0ea tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:51.899726 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-e78fea63-855b-4c96-975a-54f607f4f0ea tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:52.066789 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-e78fea63-855b-4c96-975a-54f607f4f0ea tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:52.078944 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-e78fea63-855b-4c96-975a-54f607f4f0ea tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:52.081874 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-e78fea63-855b-4c96-975a-54f607f4f0ea tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:52.083249 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-e78fea63-855b-4c96-975a-54f607f4f0ea tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52" status: 200 len: 1406 microversion: 2.20 time: 0.198540 May 19 13:35:52.083835 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 299/579] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:35:51 2022] GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52 => generated 1406 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:35:53.103022 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-dc6245ad-f8b5-48bb-86fc-fcd209b358ee tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:53.103591 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-dc6245ad-f8b5-48bb-86fc-fcd209b358ee tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 8ea882c7-9191-4712-91eb-a810e49b9e52] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:53.111030 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-dc6245ad-f8b5-48bb-86fc-fcd209b358ee tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:53.111474 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-dc6245ad-f8b5-48bb-86fc-fcd209b358ee tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:53.112238 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-dc6245ad-f8b5-48bb-86fc-fcd209b358ee tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:53.112649 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-dc6245ad-f8b5-48bb-86fc-fcd209b358ee tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:53.162450 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-382e3352-3082-45e1-8346-6b3f4c2c9ae6 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:53.162966 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-382e3352-3082-45e1-8346-6b3f4c2c9ae6 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] [instance: c97e472c-540e-4bd5-abaf-d7dadac8c6be] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:53.171843 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-382e3352-3082-45e1-8346-6b3f4c2c9ae6 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:53.172405 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-382e3352-3082-45e1-8346-6b3f4c2c9ae6 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:53.173372 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-382e3352-3082-45e1-8346-6b3f4c2c9ae6 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:53.174078 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-382e3352-3082-45e1-8346-6b3f4c2c9ae6 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:53.285282 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.objects.instance [None req-382e3352-3082-45e1-8346-6b3f4c2c9ae6 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lazy-loading 'services' on Instance uuid c97e472c-540e-4bd5-abaf-d7dadac8c6be {{(pid=120471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 13:35:53.292125 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-dc6245ad-f8b5-48bb-86fc-fcd209b358ee tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:53.302392 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-dc6245ad-f8b5-48bb-86fc-fcd209b358ee tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:53.304045 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-dc6245ad-f8b5-48bb-86fc-fcd209b358ee tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:53.305518 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-dc6245ad-f8b5-48bb-86fc-fcd209b358ee tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52" status: 200 len: 1406 microversion: 2.20 time: 0.207274 May 19 13:35:53.306190 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 281/580] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:35:53 2022] GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52 => generated 1406 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:35:53.363747 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-382e3352-3082-45e1-8346-6b3f4c2c9ae6 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] 10.222.0.24 "DELETE /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be/os-volume_attachments/cc92f313-e924-4b5c-b763-9782af3518ea" status: 202 len: 0 microversion: 2.1 time: 0.205084 May 19 13:35:53.364310 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 300/581] 10.222.0.24 () {58 vars in 1415 bytes} [Thu May 19 13:35:53 2022] DELETE /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be/os-volume_attachments/cc92f313-e924-4b5c-b763-9782af3518ea => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 13:35:53.374379 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-419ad4f1-82ed-443a-8319-a6d4f5ef8068 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:53.375400 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-419ad4f1-82ed-443a-8319-a6d4f5ef8068 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] [instance: c97e472c-540e-4bd5-abaf-d7dadac8c6be] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:53.382419 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-419ad4f1-82ed-443a-8319-a6d4f5ef8068 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:53.383035 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-419ad4f1-82ed-443a-8319-a6d4f5ef8068 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:53.383821 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-419ad4f1-82ed-443a-8319-a6d4f5ef8068 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:53.384362 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-419ad4f1-82ed-443a-8319-a6d4f5ef8068 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:53.421226 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-419ad4f1-82ed-443a-8319-a6d4f5ef8068 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] 10.222.0.24 "GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051595 May 19 13:35:53.422173 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 282/582] 10.222.0.24 () {58 vars in 1301 bytes} [Thu May 19 13:35:53 2022] GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 13:35:53.775814 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [req-30075e1b-a6be-4374-8e07-b059702941ca req-ded3b0f1-7cd1-46cb-b009-60d792e210d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c97e472c-540e-4bd5-abaf-d7dadac8c6be", "tag": "97ed1b45-3101-4569-a101-5346f9044405"}]} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:35:53.785088 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-30075e1b-a6be-4374-8e07-b059702941ca req-ded3b0f1-7cd1-46cb-b009-60d792e210d5 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:53.785567 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-30075e1b-a6be-4374-8e07-b059702941ca req-ded3b0f1-7cd1-46cb-b009-60d792e210d5 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:53.798015 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.compute.server_external_events [req-30075e1b-a6be-4374-8e07-b059702941ca req-ded3b0f1-7cd1-46cb-b009-60d792e210d5 service nova] Creating event network-changed:97ed1b45-3101-4569-a101-5346f9044405 for instance c97e472c-540e-4bd5-abaf-d7dadac8c6be on hv-cinder-84112 May 19 13:35:53.803221 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [req-30075e1b-a6be-4374-8e07-b059702941ca req-ded3b0f1-7cd1-46cb-b009-60d792e210d5 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031577 May 19 13:35:53.803822 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 301/583] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:35:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:35:54.151290 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [req-91e7980d-ec69-40aa-a6fc-c7e420ef534c req-2dc70ed6-c5b1-4d6c-b737-54cd12629715 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ea882c7-9191-4712-91eb-a810e49b9e52", "name": "network-vif-plugged", "status": "completed", "tag": "23d6a89e-f532-421c-8c67-0672e13b68a3"}]} {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:35:54.167915 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [req-91e7980d-ec69-40aa-a6fc-c7e420ef534c req-2dc70ed6-c5b1-4d6c-b737-54cd12629715 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:54.169638 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [req-91e7980d-ec69-40aa-a6fc-c7e420ef534c req-2dc70ed6-c5b1-4d6c-b737-54cd12629715 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:54.183184 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.compute.server_external_events [req-91e7980d-ec69-40aa-a6fc-c7e420ef534c req-2dc70ed6-c5b1-4d6c-b737-54cd12629715 service nova] Creating event network-vif-plugged:23d6a89e-f532-421c-8c67-0672e13b68a3 for instance 8ea882c7-9191-4712-91eb-a810e49b9e52 on hv-cinder-84112 May 19 13:35:54.188901 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [req-91e7980d-ec69-40aa-a6fc-c7e420ef534c req-2dc70ed6-c5b1-4d6c-b737-54cd12629715 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041749 May 19 13:35:54.189635 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 283/584] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:35:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:35:54.325878 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-2255215f-443a-4d41-8ceb-48a8602558ef tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:54.326733 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-2255215f-443a-4d41-8ceb-48a8602558ef tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 8ea882c7-9191-4712-91eb-a810e49b9e52] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:54.332873 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:35:54.345568 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-2255215f-443a-4d41-8ceb-48a8602558ef tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:54.346258 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-2255215f-443a-4d41-8ceb-48a8602558ef tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:54.347806 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-2255215f-443a-4d41-8ceb-48a8602558ef tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:54.348700 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-2255215f-443a-4d41-8ceb-48a8602558ef tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:54.363443 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:35:54.434592 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-56a67eac-9f95-47e3-ae43-1de3512a8a6a tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:54.436629 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-56a67eac-9f95-47e3-ae43-1de3512a8a6a tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] [instance: c97e472c-540e-4bd5-abaf-d7dadac8c6be] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:54.446829 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-56a67eac-9f95-47e3-ae43-1de3512a8a6a tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:54.447561 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-56a67eac-9f95-47e3-ae43-1de3512a8a6a tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:54.448657 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-56a67eac-9f95-47e3-ae43-1de3512a8a6a tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:54.449462 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-56a67eac-9f95-47e3-ae43-1de3512a8a6a tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:54.497600 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-56a67eac-9f95-47e3-ae43-1de3512a8a6a tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] 10.222.0.24 "GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.067671 May 19 13:35:54.498746 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 284/585] 10.222.0.24 () {58 vars in 1301 bytes} [Thu May 19 13:35:54 2022] GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be/os-volume_attachments => generated 25 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 19 13:35:54.509612 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-3a25734a-ce69-47f2-b7f2-f2bb189fdef4 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:54.510139 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-3a25734a-ce69-47f2-b7f2-f2bb189fdef4 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] [instance: c97e472c-540e-4bd5-abaf-d7dadac8c6be] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:54.518134 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-3a25734a-ce69-47f2-b7f2-f2bb189fdef4 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:54.518803 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-3a25734a-ce69-47f2-b7f2-f2bb189fdef4 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:54.519747 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-3a25734a-ce69-47f2-b7f2-f2bb189fdef4 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:54.520343 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-3a25734a-ce69-47f2-b7f2-f2bb189fdef4 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:54.584240 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-2255215f-443a-4d41-8ceb-48a8602558ef tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:54.595668 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-2255215f-443a-4d41-8ceb-48a8602558ef tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:54.598431 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-2255215f-443a-4d41-8ceb-48a8602558ef tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:54.601376 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-2255215f-443a-4d41-8ceb-48a8602558ef tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52" status: 200 len: 1406 microversion: 2.20 time: 0.280790 May 19 13:35:54.603284 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 302/586] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:35:54 2022] GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52 => generated 1406 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:35:54.620177 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.wsgi [None req-3a25734a-ce69-47f2-b7f2-f2bb189fdef4 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] HTTP exception thrown: Instance c97e472c-540e-4bd5-abaf-d7dadac8c6be is not attached to volume cc92f313-e924-4b5c-b763-9782af3518ea May 19 13:35:54.639607 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-3a25734a-ce69-47f2-b7f2-f2bb189fdef4 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Request method failure captured: May 19 13:35:54.639607 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: request: DELETE /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be/os-volume_attachments/cc92f313-e924-4b5c-b763-9782af3518ea HTTP/1.1 May 19 13:35:54.639607 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Accept: application/json May 19 13:35:54.639607 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Accept-Encoding: identity May 19 13:35:54.639607 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Connection: close May 19 13:35:54.639607 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Content-Length: 0 May 19 13:35:54.639607 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Content-Type: application/json May 19 13:35:54.639607 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Host: 10.222.0.24 May 19 13:35:54.639607 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Openstack-System-Scope: None May 19 13:35:54.639607 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: User-Agent: python-urllib3/1.26.9 May 19 13:35:54.639607 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Auth-Token: gAAAAABihkcAAWanyHQh2gKVYv8Eo_kB-k2C--61Q_he2ZAlG2Ap-nFQ-H1xtMMDrVtuLE1uCgQeKQfzZrk1MXbR7zcTco3bPCQRFayLJhwWgcXhW87DthkCvNhWUqe49s3WEPtBYwMjE9_iQPobvpyijwqiscHXUdQFxSv5P-oVF-0jw-9z5eg May 19 13:35:54.639607 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Domain-Id: None May 19 13:35:54.639607 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Domain-Name: None May 19 13:35:54.639607 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Identity-Status: Confirmed May 19 13:35:54.639607 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Is-Admin-Project: True May 19 13:35:54.639607 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Domain-Id: default May 19 13:35:54.639607 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Domain-Name: Default May 19 13:35:54.639607 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Id: 510387333865470196f9be30ef62395c May 19 13:35:54.639607 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Name: tempest-TestMinimumBasicScenario-1081812845 May 19 13:35:54.639607 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Role: reader,member May 19 13:35:54.639607 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Roles: reader,member May 19 13:35:54.641270 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/510387333865470196f9be30ef62395c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/510387333865470196f9be30ef62395c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_510387333865470196f9be30ef62395c", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/510387333865470196f9be30ef62395c"}]}] May 19 13:35:54.641270 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant: tempest-TestMinimumBasicScenario-1081812845 May 19 13:35:54.641270 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant-Id: 510387333865470196f9be30ef62395c May 19 13:35:54.641270 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1081812845 May 19 13:35:54.641270 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User: tempest-TestMinimumBasicScenario-1081812845-project May 19 13:35:54.641270 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Domain-Id: default May 19 13:35:54.641270 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Domain-Name: Default May 19 13:35:54.641270 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Id: b11df35c0e4541deaea0494759301a94 May 19 13:35:54.641270 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Name: tempest-TestMinimumBasicScenario-1081812845-project May 19 13:35:54.641270 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: method: > May 19 13:35:54.641270 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: exception: Instance c97e472c-540e-4bd5-abaf-d7dadac8c6be is not attached to volume cc92f313-e924-4b5c-b763-9782af3518ea May 19 13:35:54.642076 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: action_args: {'server_id': 'c97e472c-540e-4bd5-abaf-d7dadac8c6be', 'id': 'cc92f313-e924-4b5c-b763-9782af3518ea'} May 19 13:35:54.642076 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:35:54.642076 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:35:54.642076 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 19 13:35:54.642076 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 19 13:35:54.642076 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 13:35:54.642076 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 13:35:54.642076 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 19 13:35:54.642076 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 19 13:35:54.642076 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id cc92f313-e924-4b5c-b763-9782af3518ea. May 19 13:35:54.642076 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:35:54.642076 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:35:54.642076 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:35:54.642076 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:35:54.642076 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:35:54.642076 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:35:54.642076 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:35:54.642076 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:35:54.642076 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:35:54.643380 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:35:54.643380 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 19 13:35:54.643380 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 19 13:35:54.643380 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c97e472c-540e-4bd5-abaf-d7dadac8c6be is not attached to volume cc92f313-e924-4b5c-b763-9782af3518ea May 19 13:35:54.643380 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:35:54.643380 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:35:54.643380 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:35:54.643380 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:35:54.643380 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:35:54.643380 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:35:54.643380 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:35:54.643380 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:35:54.643380 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c97e472c-540e-4bd5-abaf-d7dadac8c6be is not attached to volume cc92f313-e924-4b5c-b763-9782af3518ea May 19 13:35:54.643380 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:35:54.643380 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-3a25734a-ce69-47f2-b7f2-f2bb189fdef4 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Returning 404 to user: Instance c97e472c-540e-4bd5-abaf-d7dadac8c6be is not attached to volume cc92f313-e924-4b5c-b763-9782af3518ea {{(pid=120472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:35:54.644513 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-3a25734a-ce69-47f2-b7f2-f2bb189fdef4 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] 10.222.0.24 "DELETE /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be/os-volume_attachments/cc92f313-e924-4b5c-b763-9782af3518ea" status: 404 len: 154 microversion: 2.1 time: 0.136196 May 19 13:35:54.644513 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 285/587] 10.222.0.24 () {58 vars in 1415 bytes} [Thu May 19 13:35:54 2022] DELETE /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be/os-volume_attachments/cc92f313-e924-4b5c-b763-9782af3518ea => generated 154 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 13:35:55.624331 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-7dbf4992-150e-4780-8476-64fcbf4872f3 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:55.624944 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-7dbf4992-150e-4780-8476-64fcbf4872f3 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 8ea882c7-9191-4712-91eb-a810e49b9e52] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:55.631892 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-7dbf4992-150e-4780-8476-64fcbf4872f3 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:55.632346 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-7dbf4992-150e-4780-8476-64fcbf4872f3 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:55.633108 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-7dbf4992-150e-4780-8476-64fcbf4872f3 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:55.633579 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-7dbf4992-150e-4780-8476-64fcbf4872f3 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:55.768024 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-7dbf4992-150e-4780-8476-64fcbf4872f3 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:55.776669 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-7dbf4992-150e-4780-8476-64fcbf4872f3 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:55.778204 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-7dbf4992-150e-4780-8476-64fcbf4872f3 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:55.779293 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-7dbf4992-150e-4780-8476-64fcbf4872f3 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52" status: 200 len: 1406 microversion: 2.20 time: 0.161979 May 19 13:35:55.779859 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 303/588] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:35:55 2022] GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:35:55.793330 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-2cce0807-4e1e-4c61-96a0-52d596f3b3af tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:55.794224 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-2cce0807-4e1e-4c61-96a0-52d596f3b3af tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] [instance: c97e472c-540e-4bd5-abaf-d7dadac8c6be] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:55.801756 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-2cce0807-4e1e-4c61-96a0-52d596f3b3af tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:55.802210 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-2cce0807-4e1e-4c61-96a0-52d596f3b3af tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:55.802995 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-2cce0807-4e1e-4c61-96a0-52d596f3b3af tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:55.803451 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-2cce0807-4e1e-4c61-96a0-52d596f3b3af tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:55.807135 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_cell1:SELECT=100 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:35:55.831872 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-2cce0807-4e1e-4c61-96a0-52d596f3b3af tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] [instance: c97e472c-540e-4bd5-abaf-d7dadac8c6be] Going to try to terminate instance {{(pid=120472) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 13:35:55.916203 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-2cce0807-4e1e-4c61-96a0-52d596f3b3af tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] 10.222.0.24 "DELETE /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be" status: 204 len: 0 microversion: 2.1 time: 0.127952 May 19 13:35:55.916792 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 286/589] 10.222.0.24 () {58 vars in 1238 bytes} [Thu May 19 13:35:55 2022] DELETE /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 13:35:55.925656 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-eb0caacd-a1a2-4460-ad55-1d6cb76dace4 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:55.926260 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-eb0caacd-a1a2-4460-ad55-1d6cb76dace4 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] [instance: c97e472c-540e-4bd5-abaf-d7dadac8c6be] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:55.932550 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-eb0caacd-a1a2-4460-ad55-1d6cb76dace4 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:55.933004 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-eb0caacd-a1a2-4460-ad55-1d6cb76dace4 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:55.933793 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-eb0caacd-a1a2-4460-ad55-1d6cb76dace4 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:55.934236 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-eb0caacd-a1a2-4460-ad55-1d6cb76dace4 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:56.070328 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-eb0caacd-a1a2-4460-ad55-1d6cb76dace4 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11df35c0e4541deaea0494759301a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '510387333865470196f9be30ef62395c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:56.078421 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-eb0caacd-a1a2-4460-ad55-1d6cb76dace4 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] 10.222.0.24 "GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be" status: 200 len: 1554 microversion: 2.1 time: 0.156717 May 19 13:35:56.078991 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 304/590] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:35:55 2022] GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:35:56.800995 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-5eb8812f-d0fa-4c14-863c-b71c22fd51cb tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:56.801806 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-5eb8812f-d0fa-4c14-863c-b71c22fd51cb tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 8ea882c7-9191-4712-91eb-a810e49b9e52] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:56.809763 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-5eb8812f-d0fa-4c14-863c-b71c22fd51cb tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:56.810265 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-5eb8812f-d0fa-4c14-863c-b71c22fd51cb tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:56.811109 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-5eb8812f-d0fa-4c14-863c-b71c22fd51cb tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:56.811585 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-5eb8812f-d0fa-4c14-863c-b71c22fd51cb tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:56.951629 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-5eb8812f-d0fa-4c14-863c-b71c22fd51cb tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:56.964319 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-5eb8812f-d0fa-4c14-863c-b71c22fd51cb tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:56.966507 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-5eb8812f-d0fa-4c14-863c-b71c22fd51cb tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:56.967866 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-5eb8812f-d0fa-4c14-863c-b71c22fd51cb tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52" status: 200 len: 1599 microversion: 2.20 time: 0.172327 May 19 13:35:56.968424 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 287/591] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:35:56 2022] GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52 => generated 1599 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:35:56.986157 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-222d0f33-ab3a-4f44-a4e4-57a26208b571 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:56.986747 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-222d0f33-ab3a-4f44-a4e4-57a26208b571 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 8ea882c7-9191-4712-91eb-a810e49b9e52] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:56.993706 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-222d0f33-ab3a-4f44-a4e4-57a26208b571 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:56.994162 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-222d0f33-ab3a-4f44-a4e4-57a26208b571 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:56.994919 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-222d0f33-ab3a-4f44-a4e4-57a26208b571 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:56.995347 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-222d0f33-ab3a-4f44-a4e4-57a26208b571 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:57.082781 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-222d0f33-ab3a-4f44-a4e4-57a26208b571 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.100815 May 19 13:35:57.083630 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 305/592] 10.222.0.24 () {60 vars in 1315 bytes} [Thu May 19 13:35:56 2022] GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52/os-interface => generated 285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 19 13:35:57.100231 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-e25a9339-c5e2-44fe-8c59-e0208345cf5e tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:57.100837 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-e25a9339-c5e2-44fe-8c59-e0208345cf5e tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] [instance: c97e472c-540e-4bd5-abaf-d7dadac8c6be] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:57.107254 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-e25a9339-c5e2-44fe-8c59-e0208345cf5e tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:57.107702 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-e25a9339-c5e2-44fe-8c59-e0208345cf5e tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:57.108887 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-e25a9339-c5e2-44fe-8c59-e0208345cf5e tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:57.109312 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-e25a9339-c5e2-44fe-8c59-e0208345cf5e tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:57.372963 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-e25a9339-c5e2-44fe-8c59-e0208345cf5e tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11df35c0e4541deaea0494759301a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '510387333865470196f9be30ef62395c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:57.381881 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-e25a9339-c5e2-44fe-8c59-e0208345cf5e tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] 10.222.0.24 "GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be" status: 200 len: 1554 microversion: 2.1 time: 0.285524 May 19 13:35:57.382529 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 288/593] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:35:57 2022] GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be => generated 1554 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:35:58.131417 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [req-a951534b-d6b3-4289-a443-1b0b9e1e8c58 req-6339c73c-5a18-464e-8057-67125dbafbb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ea882c7-9191-4712-91eb-a810e49b9e52", "tag": "23d6a89e-f532-421c-8c67-0672e13b68a3"}]} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:35:58.140133 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-a951534b-d6b3-4289-a443-1b0b9e1e8c58 req-6339c73c-5a18-464e-8057-67125dbafbb5 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:58.140568 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-a951534b-d6b3-4289-a443-1b0b9e1e8c58 req-6339c73c-5a18-464e-8057-67125dbafbb5 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:58.151882 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.compute.server_external_events [req-a951534b-d6b3-4289-a443-1b0b9e1e8c58 req-6339c73c-5a18-464e-8057-67125dbafbb5 service nova] Creating event network-changed:23d6a89e-f532-421c-8c67-0672e13b68a3 for instance 8ea882c7-9191-4712-91eb-a810e49b9e52 on hv-cinder-84112 May 19 13:35:58.156783 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [req-a951534b-d6b3-4289-a443-1b0b9e1e8c58 req-6339c73c-5a18-464e-8057-67125dbafbb5 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030346 May 19 13:35:58.157393 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 306/594] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:35:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:35:58.400157 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-8b0e9296-4d7e-46be-8710-e3df0adccafd tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:58.400888 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-8b0e9296-4d7e-46be-8710-e3df0adccafd tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] [instance: c97e472c-540e-4bd5-abaf-d7dadac8c6be] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:58.408111 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-8b0e9296-4d7e-46be-8710-e3df0adccafd tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:58.408919 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-8b0e9296-4d7e-46be-8710-e3df0adccafd tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:58.409847 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-8b0e9296-4d7e-46be-8710-e3df0adccafd tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:58.410518 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-8b0e9296-4d7e-46be-8710-e3df0adccafd tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:58.655617 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-8b0e9296-4d7e-46be-8710-e3df0adccafd tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11df35c0e4541deaea0494759301a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '510387333865470196f9be30ef62395c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:35:58.664926 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-8b0e9296-4d7e-46be-8710-e3df0adccafd tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] 10.222.0.24 "GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be" status: 200 len: 1554 microversion: 2.1 time: 0.265177 May 19 13:35:58.675733 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 289/595] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:35:58 2022] GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be => generated 1554 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:35:59.685171 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-4b0211d2-e493-4964-8968-8a9f94677774 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:59.685971 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-4b0211d2-e493-4964-8968-8a9f94677774 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] [instance: c97e472c-540e-4bd5-abaf-d7dadac8c6be] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:35:59.693293 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-4b0211d2-e493-4964-8968-8a9f94677774 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:59.693775 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-4b0211d2-e493-4964-8968-8a9f94677774 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:59.694535 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-4b0211d2-e493-4964-8968-8a9f94677774 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:35:59.694964 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-4b0211d2-e493-4964-8968-8a9f94677774 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:35:59.709715 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.wsgi [None req-4b0211d2-e493-4964-8968-8a9f94677774 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] HTTP exception thrown: Instance c97e472c-540e-4bd5-abaf-d7dadac8c6be could not be found. May 19 13:35:59.711324 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-4b0211d2-e493-4964-8968-8a9f94677774 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Request method failure captured: May 19 13:35:59.711324 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: request: GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be HTTP/1.1 May 19 13:35:59.711324 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Accept: application/json May 19 13:35:59.711324 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Accept-Encoding: identity May 19 13:35:59.711324 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Connection: close May 19 13:35:59.711324 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Content-Length: 0 May 19 13:35:59.711324 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Content-Type: application/json May 19 13:35:59.711324 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Host: 10.222.0.24 May 19 13:35:59.711324 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Openstack-System-Scope: None May 19 13:35:59.711324 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: User-Agent: python-urllib3/1.26.9 May 19 13:35:59.711324 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Auth-Token: gAAAAABihkcAAWanyHQh2gKVYv8Eo_kB-k2C--61Q_he2ZAlG2Ap-nFQ-H1xtMMDrVtuLE1uCgQeKQfzZrk1MXbR7zcTco3bPCQRFayLJhwWgcXhW87DthkCvNhWUqe49s3WEPtBYwMjE9_iQPobvpyijwqiscHXUdQFxSv5P-oVF-0jw-9z5eg May 19 13:35:59.711324 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Domain-Id: None May 19 13:35:59.711324 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Domain-Name: None May 19 13:35:59.711324 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Identity-Status: Confirmed May 19 13:35:59.711324 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Is-Admin-Project: True May 19 13:35:59.711324 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Domain-Id: default May 19 13:35:59.711324 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Domain-Name: Default May 19 13:35:59.711324 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Id: 510387333865470196f9be30ef62395c May 19 13:35:59.711324 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Name: tempest-TestMinimumBasicScenario-1081812845 May 19 13:35:59.711324 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Role: reader,member May 19 13:35:59.711324 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Roles: reader,member May 19 13:35:59.712719 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/510387333865470196f9be30ef62395c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/510387333865470196f9be30ef62395c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_510387333865470196f9be30ef62395c", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/510387333865470196f9be30ef62395c"}]}] May 19 13:35:59.712719 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Tenant: tempest-TestMinimumBasicScenario-1081812845 May 19 13:35:59.712719 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Tenant-Id: 510387333865470196f9be30ef62395c May 19 13:35:59.712719 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1081812845 May 19 13:35:59.712719 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User: tempest-TestMinimumBasicScenario-1081812845-project May 19 13:35:59.712719 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Domain-Id: default May 19 13:35:59.712719 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Domain-Name: Default May 19 13:35:59.712719 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Id: b11df35c0e4541deaea0494759301a94 May 19 13:35:59.712719 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Name: tempest-TestMinimumBasicScenario-1081812845-project May 19 13:35:59.712719 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: method: > May 19 13:35:59.712719 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: exception: Instance c97e472c-540e-4bd5-abaf-d7dadac8c6be could not be found. May 19 13:35:59.712719 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: action_args: {'id': 'c97e472c-540e-4bd5-abaf-d7dadac8c6be'} May 19 13:35:59.713480 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:35:59.713480 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:35:59.713480 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 13:35:59.713480 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 13:35:59.713480 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 13:35:59.713480 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 13:35:59.713480 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 13:35:59.713480 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 13:35:59.713480 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 13:35:59.713480 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 13:35:59.713480 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c97e472c-540e-4bd5-abaf-d7dadac8c6be could not be found. May 19 13:35:59.713480 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:35:59.713480 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:35:59.713480 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:35:59.713480 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:35:59.713480 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:35:59.713480 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:35:59.713480 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:35:59.713480 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:35:59.713480 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:35:59.714929 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:35:59.714929 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 13:35:59.714929 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 13:35:59.714929 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 13:35:59.714929 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 13:35:59.714929 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 13:35:59.714929 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 13:35:59.714929 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c97e472c-540e-4bd5-abaf-d7dadac8c6be could not be found. May 19 13:35:59.714929 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:35:59.714929 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:35:59.714929 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:35:59.714929 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:35:59.714929 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:35:59.714929 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:35:59.714929 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:35:59.714929 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:35:59.714929 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c97e472c-540e-4bd5-abaf-d7dadac8c6be could not be found. May 19 13:35:59.714929 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:35:59.716442 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-4b0211d2-e493-4964-8968-8a9f94677774 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Returning 404 to user: Instance c97e472c-540e-4bd5-abaf-d7dadac8c6be could not be found. {{(pid=120471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:35:59.716442 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-4b0211d2-e493-4964-8968-8a9f94677774 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] 10.222.0.24 "GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be" status: 404 len: 111 microversion: 2.1 time: 0.032580 May 19 13:35:59.716442 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 307/596] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:35:59 2022] GET /compute/v2.1/servers/c97e472c-540e-4bd5-abaf-d7dadac8c6be => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 13:35:59.722060 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-4e7f5d31-6bb5-4035-b36b-7a1e89087b28 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] Calling method '.version_select at 0x7f7c2a5dddc0>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:35:59.744452 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-4e7f5d31-6bb5-4035-b36b-7a1e89087b28 tempest-TestMinimumBasicScenario-1081812845 tempest-TestMinimumBasicScenario-1081812845-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-534003201" status: 202 len: 0 microversion: 2.1 time: 0.026338 May 19 13:35:59.745014 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 290/597] 10.222.0.24 () {58 vars in 1268 bytes} [Thu May 19 13:35:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-534003201 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 13:36:00.174113 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [req-3c47d522-0e20-4f36-90ff-a27f352e1b84 req-ba1fcd59-c521-4207-8dd1-eb833ffb1431 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c97e472c-540e-4bd5-abaf-d7dadac8c6be", "name": "network-vif-deleted", "tag": "97ed1b45-3101-4569-a101-5346f9044405"}]} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:36:00.184548 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-3c47d522-0e20-4f36-90ff-a27f352e1b84 req-ba1fcd59-c521-4207-8dd1-eb833ffb1431 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:00.185024 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-3c47d522-0e20-4f36-90ff-a27f352e1b84 req-ba1fcd59-c521-4207-8dd1-eb833ffb1431 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:00.198027 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.compute.server_external_events [req-3c47d522-0e20-4f36-90ff-a27f352e1b84 req-ba1fcd59-c521-4207-8dd1-eb833ffb1431 service nova] Creating event network-vif-deleted:97ed1b45-3101-4569-a101-5346f9044405 for instance c97e472c-540e-4bd5-abaf-d7dadac8c6be on hv-cinder-84112 May 19 13:36:00.203728 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [req-3c47d522-0e20-4f36-90ff-a27f352e1b84 req-ba1fcd59-c521-4207-8dd1-eb833ffb1431 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035199 May 19 13:36:00.204534 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 308/598] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:36:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:36:24.102887 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:36:24.105330 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:36:24.114708 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-20bba008-69f3-4506-b07d-30e97540e515 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:36:24.115339 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-20bba008-69f3-4506-b07d-30e97540e515 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: 8a3b02c0-6943-45dc-9086-16ff29536118] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:36:24.136036 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-20bba008-69f3-4506-b07d-30e97540e515 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:24.136594 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-20bba008-69f3-4506-b07d-30e97540e515 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:24.137898 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-20bba008-69f3-4506-b07d-30e97540e515 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:24.140726 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-20bba008-69f3-4506-b07d-30e97540e515 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:24.524362 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.objects.instance [None req-20bba008-69f3-4506-b07d-30e97540e515 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lazy-loading 'services' on Instance uuid 8a3b02c0-6943-45dc-9086-16ff29536118 {{(pid=120472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 13:36:24.614250 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-20bba008-69f3-4506-b07d-30e97540e515 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "DELETE /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118/os-volume_attachments/1fd6b6b4-1ff0-45c4-a900-1a2bfa30a3d4" status: 202 len: 0 microversion: 2.1 time: 0.513838 May 19 13:36:24.615155 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 291/599] 10.222.0.24 () {58 vars in 1415 bytes} [Thu May 19 13:36:24 2022] DELETE /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118/os-volume_attachments/1fd6b6b4-1ff0-45c4-a900-1a2bfa30a3d4 => generated 0 bytes in 515 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 13:36:24.625213 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-e1829db0-255f-4344-b75b-de191ceae7de tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:36:24.626377 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-e1829db0-255f-4344-b75b-de191ceae7de tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: 8a3b02c0-6943-45dc-9086-16ff29536118] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:36:24.634739 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_api:SELECT=13 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:36:24.636020 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_cell1:SELECT=27 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:36:24.638428 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-e1829db0-255f-4344-b75b-de191ceae7de tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:24.638873 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-e1829db0-255f-4344-b75b-de191ceae7de tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:24.640043 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-e1829db0-255f-4344-b75b-de191ceae7de tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:24.640689 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-e1829db0-255f-4344-b75b-de191ceae7de tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:24.677565 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-e1829db0-255f-4344-b75b-de191ceae7de tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057875 May 19 13:36:24.678143 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 309/600] 10.222.0.24 () {58 vars in 1301 bytes} [Thu May 19 13:36:24 2022] GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:36:25.694710 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-7928323f-d802-4558-88c0-d44d2523fb64 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:36:25.695849 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-7928323f-d802-4558-88c0-d44d2523fb64 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: 8a3b02c0-6943-45dc-9086-16ff29536118] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:36:25.702613 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-7928323f-d802-4558-88c0-d44d2523fb64 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:25.703407 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-7928323f-d802-4558-88c0-d44d2523fb64 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:25.704207 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-7928323f-d802-4558-88c0-d44d2523fb64 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:25.704633 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-7928323f-d802-4558-88c0-d44d2523fb64 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:25.735247 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-7928323f-d802-4558-88c0-d44d2523fb64 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049542 May 19 13:36:25.736120 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 292/601] 10.222.0.24 () {58 vars in 1301 bytes} [Thu May 19 13:36:25 2022] GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:36:26.747201 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-4b0e6264-60b4-4498-9b48-854f8596f968 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:36:26.748291 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-4b0e6264-60b4-4498-9b48-854f8596f968 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: 8a3b02c0-6943-45dc-9086-16ff29536118] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:36:26.755586 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-4b0e6264-60b4-4498-9b48-854f8596f968 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:26.756568 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-4b0e6264-60b4-4498-9b48-854f8596f968 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:26.757837 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-4b0e6264-60b4-4498-9b48-854f8596f968 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:26.758489 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-4b0e6264-60b4-4498-9b48-854f8596f968 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:26.794770 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-4b0e6264-60b4-4498-9b48-854f8596f968 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051373 May 19 13:36:26.795870 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 310/602] 10.222.0.24 () {58 vars in 1301 bytes} [Thu May 19 13:36:26 2022] GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 13:36:26.881039 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-2562ef2a-0e2d-420c-bcff-5a2cce13b369 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:36:26.881581 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-2562ef2a-0e2d-420c-bcff-5a2cce13b369 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: 8a3b02c0-6943-45dc-9086-16ff29536118] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:36:26.888146 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-2562ef2a-0e2d-420c-bcff-5a2cce13b369 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:26.888594 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-2562ef2a-0e2d-420c-bcff-5a2cce13b369 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:26.889349 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-2562ef2a-0e2d-420c-bcff-5a2cce13b369 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:26.890191 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-2562ef2a-0e2d-420c-bcff-5a2cce13b369 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:26.916739 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-2562ef2a-0e2d-420c-bcff-5a2cce13b369 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: 8a3b02c0-6943-45dc-9086-16ff29536118] Going to try to terminate instance {{(pid=120472) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 13:36:27.018542 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-2562ef2a-0e2d-420c-bcff-5a2cce13b369 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "DELETE /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118" status: 204 len: 0 microversion: 2.1 time: 0.144712 May 19 13:36:27.020026 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 293/603] 10.222.0.24 () {58 vars in 1238 bytes} [Thu May 19 13:36:26 2022] DELETE /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 13:36:27.028470 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-a96064b2-eedc-4008-938c-c35a2484564c tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:36:27.030014 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-a96064b2-eedc-4008-938c-c35a2484564c tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: 8a3b02c0-6943-45dc-9086-16ff29536118] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:36:27.037913 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-a96064b2-eedc-4008-938c-c35a2484564c tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:27.038587 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-a96064b2-eedc-4008-938c-c35a2484564c tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:27.040265 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-a96064b2-eedc-4008-938c-c35a2484564c tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:27.040901 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-a96064b2-eedc-4008-938c-c35a2484564c tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:27.566581 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-a96064b2-eedc-4008-938c-c35a2484564c tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:36:27.578748 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-a96064b2-eedc-4008-938c-c35a2484564c tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118" status: 200 len: 1687 microversion: 2.1 time: 0.554400 May 19 13:36:27.580023 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 311/604] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:36:27 2022] GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118 => generated 1687 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:36:28.597866 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-ab5aa080-8d3e-4db2-a713-00d79d44767e tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:36:28.599777 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-ab5aa080-8d3e-4db2-a713-00d79d44767e tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: 8a3b02c0-6943-45dc-9086-16ff29536118] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:36:28.609855 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-ab5aa080-8d3e-4db2-a713-00d79d44767e tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:28.610640 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-ab5aa080-8d3e-4db2-a713-00d79d44767e tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:28.612684 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-ab5aa080-8d3e-4db2-a713-00d79d44767e tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:28.613495 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-ab5aa080-8d3e-4db2-a713-00d79d44767e tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:28.795879 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-ab5aa080-8d3e-4db2-a713-00d79d44767e tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:36:28.804616 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-ab5aa080-8d3e-4db2-a713-00d79d44767e tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118" status: 200 len: 1687 microversion: 2.1 time: 0.211929 May 19 13:36:28.817030 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 294/605] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:36:28 2022] GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118 => generated 1687 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:36:29.822017 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-201d906b-b986-424a-bd16-3a94af8064e9 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:36:29.822609 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-201d906b-b986-424a-bd16-3a94af8064e9 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: 8a3b02c0-6943-45dc-9086-16ff29536118] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:36:29.830171 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-201d906b-b986-424a-bd16-3a94af8064e9 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:29.830700 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-201d906b-b986-424a-bd16-3a94af8064e9 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:29.831526 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-201d906b-b986-424a-bd16-3a94af8064e9 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:29.832210 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-201d906b-b986-424a-bd16-3a94af8064e9 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:30.008038 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-201d906b-b986-424a-bd16-3a94af8064e9 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:36:30.026059 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-201d906b-b986-424a-bd16-3a94af8064e9 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118" status: 200 len: 1687 microversion: 2.1 time: 0.207666 May 19 13:36:30.036797 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 312/606] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:36:29 2022] GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118 => generated 1687 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:36:30.474576 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-57d80d28-e2d4-47bb-964f-a28d35b7afeb tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Action: 'create', calling method: .version_select at 0x7f7c2a57bb80>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1595031897", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL8Ug9Oj42TPyzTBz1HbrpJy5j6dfKKeHWXLAuzOTdd3b4LITFV30kDnO4blBbYFV50mfZJJ3ZYmzPD5wwcD5BhJ0HjCluKkLci1/uBdDGcqXsb2Pw7XUz7+36MBZd4ebQ=="}} {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:36:30.490835 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.quota [None req-57d80d28-e2d4-47bb-964f-a28d35b7afeb tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Getting quotas for project 98ad7b921dbc4a8d9e9be0d50385deee. Resources: {'key_pairs'} {{(pid=120472) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 13:36:30.495028 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.quota [None req-57d80d28-e2d4-47bb-964f-a28d35b7afeb tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Getting quotas for user aa0a4b41707d444581ee0aa2296ac0ba and project 98ad7b921dbc4a8d9e9be0d50385deee. Resources: {'key_pairs'} {{(pid=120472) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 13:36:30.520681 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-57d80d28-e2d4-47bb-964f-a28d35b7afeb tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.160685 May 19 13:36:30.526573 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 295/607] 10.222.0.24 () {60 vars in 1158 bytes} [Thu May 19 13:36:30 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:36:31.044516 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-109caa80-ec58-4dc0-97ac-9ec624e7c41c tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:36:31.046332 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-109caa80-ec58-4dc0-97ac-9ec624e7c41c tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: 8a3b02c0-6943-45dc-9086-16ff29536118] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:36:31.056010 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-109caa80-ec58-4dc0-97ac-9ec624e7c41c tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:31.057040 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-109caa80-ec58-4dc0-97ac-9ec624e7c41c tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:31.058212 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-109caa80-ec58-4dc0-97ac-9ec624e7c41c tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:31.058903 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-109caa80-ec58-4dc0-97ac-9ec624e7c41c tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:31.375081 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-109caa80-ec58-4dc0-97ac-9ec624e7c41c tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:36:31.387315 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-109caa80-ec58-4dc0-97ac-9ec624e7c41c tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118" status: 200 len: 1619 microversion: 2.1 time: 0.346756 May 19 13:36:31.400832 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 313/608] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:36:31 2022] GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118 => generated 1619 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:36:31.494231 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [req-da8abf76-10c7-41a3-930b-459f18a41a7f req-44e2e6f8-57c2-42cc-a999-d54b7d572363 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a3b02c0-6943-45dc-9086-16ff29536118", "name": "network-vif-deleted", "tag": "3d603fe2-3873-40ee-9c1d-9815f7c92788"}]} {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:36:31.505158 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [req-da8abf76-10c7-41a3-930b-459f18a41a7f req-44e2e6f8-57c2-42cc-a999-d54b7d572363 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:31.505637 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [req-da8abf76-10c7-41a3-930b-459f18a41a7f req-44e2e6f8-57c2-42cc-a999-d54b7d572363 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:31.519214 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.compute.server_external_events [req-da8abf76-10c7-41a3-930b-459f18a41a7f req-44e2e6f8-57c2-42cc-a999-d54b7d572363 service nova] Creating event network-vif-deleted:3d603fe2-3873-40ee-9c1d-9815f7c92788 for instance 8a3b02c0-6943-45dc-9086-16ff29536118 on hv-cinder-84112 May 19 13:36:31.525645 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [req-da8abf76-10c7-41a3-930b-459f18a41a7f req-44e2e6f8-57c2-42cc-a999-d54b7d572363 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037333 May 19 13:36:31.526486 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 296/609] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:36:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:36:32.407908 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-51ae830e-3863-4f80-8fde-3d28ef68d4f0 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:36:32.408497 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-51ae830e-3863-4f80-8fde-3d28ef68d4f0 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: 8a3b02c0-6943-45dc-9086-16ff29536118] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:36:32.415722 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-51ae830e-3863-4f80-8fde-3d28ef68d4f0 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:32.416205 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-51ae830e-3863-4f80-8fde-3d28ef68d4f0 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:32.417004 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-51ae830e-3863-4f80-8fde-3d28ef68d4f0 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:32.417951 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-51ae830e-3863-4f80-8fde-3d28ef68d4f0 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:32.433527 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.wsgi [None req-51ae830e-3863-4f80-8fde-3d28ef68d4f0 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] HTTP exception thrown: Instance 8a3b02c0-6943-45dc-9086-16ff29536118 could not be found. May 19 13:36:32.435331 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-51ae830e-3863-4f80-8fde-3d28ef68d4f0 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Request method failure captured: May 19 13:36:32.435331 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: request: GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118 HTTP/1.1 May 19 13:36:32.435331 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Accept: application/json May 19 13:36:32.435331 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Accept-Encoding: identity May 19 13:36:32.435331 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Connection: close May 19 13:36:32.435331 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Content-Length: 0 May 19 13:36:32.435331 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Content-Type: application/json May 19 13:36:32.435331 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Host: 10.222.0.24 May 19 13:36:32.435331 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Openstack-System-Scope: None May 19 13:36:32.435331 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: User-Agent: python-urllib3/1.26.9 May 19 13:36:32.435331 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Auth-Token: gAAAAABihka28w_XrUfaOtaJo3uOu_VKP25qoARCt1sMNKJyTv9Zs2UdBFAMxpQQTuZSPm5_OGrEsu9-FHYT7rVvy0PjGuvfYySPIV0FbQR2CrL-a-e1bGrkGoxusbmks-C9euLBSRZS_Ru4AaJkLiaaCt15rraZYv-Ku8n3RqspqC_JYm_SeyE May 19 13:36:32.435331 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Domain-Id: None May 19 13:36:32.435331 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Domain-Name: None May 19 13:36:32.435331 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Identity-Status: Confirmed May 19 13:36:32.435331 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Is-Admin-Project: True May 19 13:36:32.435331 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Domain-Id: default May 19 13:36:32.435331 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Domain-Name: Default May 19 13:36:32.435331 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Id: 63972a518bb048d19dd070eb9ac85445 May 19 13:36:32.435331 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-217359763 May 19 13:36:32.435331 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Role: reader,member May 19 13:36:32.435331 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Roles: reader,member May 19 13:36:32.437087 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/63972a518bb048d19dd070eb9ac85445"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/63972a518bb048d19dd070eb9ac85445"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_63972a518bb048d19dd070eb9ac85445", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/63972a518bb048d19dd070eb9ac85445"}]}] May 19 13:36:32.437087 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Tenant: tempest-ServerRescueNegativeTestJSON-217359763 May 19 13:36:32.437087 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Tenant-Id: 63972a518bb048d19dd070eb9ac85445 May 19 13:36:32.437087 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-217359763 May 19 13:36:32.437087 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User: tempest-ServerRescueNegativeTestJSON-217359763-project May 19 13:36:32.437087 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Domain-Id: default May 19 13:36:32.437087 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Domain-Name: Default May 19 13:36:32.437087 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Id: 2d3b91bfd0304cc793e3ad52c9b9e865 May 19 13:36:32.437087 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Name: tempest-ServerRescueNegativeTestJSON-217359763-project May 19 13:36:32.437087 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: method: > May 19 13:36:32.437087 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: exception: Instance 8a3b02c0-6943-45dc-9086-16ff29536118 could not be found. May 19 13:36:32.437087 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: action_args: {'id': '8a3b02c0-6943-45dc-9086-16ff29536118'} May 19 13:36:32.437981 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:36:32.437981 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:36:32.437981 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 13:36:32.437981 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 13:36:32.437981 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 13:36:32.437981 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 13:36:32.437981 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 13:36:32.437981 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 13:36:32.437981 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 13:36:32.437981 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 13:36:32.437981 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a3b02c0-6943-45dc-9086-16ff29536118 could not be found. May 19 13:36:32.437981 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:36:32.437981 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:36:32.437981 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:36:32.437981 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:36:32.437981 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:36:32.437981 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:36:32.437981 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:36:32.437981 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:36:32.437981 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:36:32.439859 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:36:32.439859 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 13:36:32.439859 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 13:36:32.439859 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 13:36:32.439859 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 13:36:32.439859 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 13:36:32.439859 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 13:36:32.439859 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a3b02c0-6943-45dc-9086-16ff29536118 could not be found. May 19 13:36:32.439859 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:36:32.439859 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:36:32.439859 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:36:32.439859 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:36:32.439859 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:36:32.439859 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:36:32.439859 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:36:32.439859 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:36:32.439859 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a3b02c0-6943-45dc-9086-16ff29536118 could not be found. May 19 13:36:32.439859 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:36:32.442519 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-51ae830e-3863-4f80-8fde-3d28ef68d4f0 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Returning 404 to user: Instance 8a3b02c0-6943-45dc-9086-16ff29536118 could not be found. {{(pid=120471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:36:32.443490 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-51ae830e-3863-4f80-8fde-3d28ef68d4f0 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118" status: 404 len: 111 microversion: 2.1 time: 0.039760 May 19 13:36:32.444084 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 314/610] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:36:32 2022] GET /compute/v2.1/servers/8a3b02c0-6943-45dc-9086-16ff29536118 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 13:36:32.453636 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-334062bc-4556-4bbd-b56a-affb6d2abdbd tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '.version_select at 0x7f7c2a4a9b80>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:36:32.475663 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-334062bc-4556-4bbd-b56a-affb6d2abdbd tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-768143211" status: 202 len: 0 microversion: 2.1 time: 0.026658 May 19 13:36:32.476333 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 297/611] 10.222.0.24 () {58 vars in 1217 bytes} [Thu May 19 13:36:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-768143211 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 13:36:34.587548 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-958596fb-48c6-4f28-9fb6-3cba0c06fef5 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:36:34.588054 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-958596fb-48c6-4f28-9fb6-3cba0c06fef5 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 8ea882c7-9191-4712-91eb-a810e49b9e52] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:36:34.594349 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-958596fb-48c6-4f28-9fb6-3cba0c06fef5 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:34.594784 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-958596fb-48c6-4f28-9fb6-3cba0c06fef5 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:34.595546 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-958596fb-48c6-4f28-9fb6-3cba0c06fef5 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:34.595966 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-958596fb-48c6-4f28-9fb6-3cba0c06fef5 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:34.621765 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-958596fb-48c6-4f28-9fb6-3cba0c06fef5 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52/ips" status: 200 len: 153 microversion: 2.20 time: 0.157184 May 19 13:36:34.622433 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 315/612] 10.222.0.24 () {60 vars in 1288 bytes} [Thu May 19 13:36:34 2022] GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52/ips => generated 153 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 19 13:36:35.521663 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-3d211653-534f-4d31-908b-3ec1ab06ea5a tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:36:35.522332 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-3d211653-534f-4d31-908b-3ec1ab06ea5a tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: bb839e22-971b-4313-be06-20e09838215a] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:36:35.528785 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-3d211653-534f-4d31-908b-3ec1ab06ea5a tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:35.529256 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-3d211653-534f-4d31-908b-3ec1ab06ea5a tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:35.530055 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-3d211653-534f-4d31-908b-3ec1ab06ea5a tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:35.530488 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-3d211653-534f-4d31-908b-3ec1ab06ea5a tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:35.557593 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-3d211653-534f-4d31-908b-3ec1ab06ea5a tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: bb839e22-971b-4313-be06-20e09838215a] Going to try to terminate instance {{(pid=120472) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 13:36:35.647310 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-3d211653-534f-4d31-908b-3ec1ab06ea5a tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "DELETE /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a" status: 204 len: 0 microversion: 2.1 time: 0.129147 May 19 13:36:35.647900 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 298/613] 10.222.0.24 () {58 vars in 1238 bytes} [Thu May 19 13:36:35 2022] DELETE /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 13:36:35.655982 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-ffacc453-0520-4c16-a22d-f3667a0d5ba5 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:36:35.656584 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-ffacc453-0520-4c16-a22d-f3667a0d5ba5 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: bb839e22-971b-4313-be06-20e09838215a] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:36:35.663984 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-ffacc453-0520-4c16-a22d-f3667a0d5ba5 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:35.664548 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-ffacc453-0520-4c16-a22d-f3667a0d5ba5 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:35.665778 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-ffacc453-0520-4c16-a22d-f3667a0d5ba5 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:35.666234 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-ffacc453-0520-4c16-a22d-f3667a0d5ba5 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:35.807339 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-ffacc453-0520-4c16-a22d-f3667a0d5ba5 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:36:35.815396 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-ffacc453-0520-4c16-a22d-f3667a0d5ba5 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a" status: 200 len: 1508 microversion: 2.1 time: 0.163335 May 19 13:36:35.816398 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 316/614] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:36:35 2022] GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a => generated 1508 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:36:36.944703 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-1c2cbdf7-78b8-49cf-a07c-879a4e6979f7 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:36:36.945448 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-1c2cbdf7-78b8-49cf-a07c-879a4e6979f7 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: bb839e22-971b-4313-be06-20e09838215a] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:36:36.951879 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-1c2cbdf7-78b8-49cf-a07c-879a4e6979f7 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:36.952323 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-1c2cbdf7-78b8-49cf-a07c-879a4e6979f7 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:36.953123 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-1c2cbdf7-78b8-49cf-a07c-879a4e6979f7 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:36.953588 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-1c2cbdf7-78b8-49cf-a07c-879a4e6979f7 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:37.043703 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-27f9ae62-651f-4b3a-bc95-a45d46249640 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:36:37.044552 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-27f9ae62-651f-4b3a-bc95-a45d46249640 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 8ea882c7-9191-4712-91eb-a810e49b9e52] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:36:37.052457 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-27f9ae62-651f-4b3a-bc95-a45d46249640 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:37.052908 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-27f9ae62-651f-4b3a-bc95-a45d46249640 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:37.053717 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-27f9ae62-651f-4b3a-bc95-a45d46249640 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:37.054148 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-27f9ae62-651f-4b3a-bc95-a45d46249640 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:37.079689 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.objects.instance [None req-27f9ae62-651f-4b3a-bc95-a45d46249640 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lazy-loading 'flavor' on Instance uuid 8ea882c7-9191-4712-91eb-a810e49b9e52 {{(pid=120471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 13:36:37.089277 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-1c2cbdf7-78b8-49cf-a07c-879a4e6979f7 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:36:37.097831 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-1c2cbdf7-78b8-49cf-a07c-879a4e6979f7 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a" status: 200 len: 1508 microversion: 2.1 time: 0.269236 May 19 13:36:37.098418 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 299/615] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:36:36 2022] GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a => generated 1508 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:36:37.338089 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-27f9ae62-651f-4b3a-bc95-a45d46249640 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "POST /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52/action" status: 202 len: 0 microversion: 2.20 time: 0.298340 May 19 13:36:37.338697 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 317/616] 10.222.0.24 () {62 vars in 1318 bytes} [Thu May 19 13:36:37 2022] POST /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52/action => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 19 13:36:37.346949 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-19fd2678-56de-4300-8d4d-c054585aae38 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:36:37.347555 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-19fd2678-56de-4300-8d4d-c054585aae38 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 8ea882c7-9191-4712-91eb-a810e49b9e52] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:36:37.354216 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-19fd2678-56de-4300-8d4d-c054585aae38 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:37.354686 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-19fd2678-56de-4300-8d4d-c054585aae38 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:37.355418 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-19fd2678-56de-4300-8d4d-c054585aae38 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:37.355850 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-19fd2678-56de-4300-8d4d-c054585aae38 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:37.497326 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-19fd2678-56de-4300-8d4d-c054585aae38 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:36:37.507234 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-19fd2678-56de-4300-8d4d-c054585aae38 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:36:37.508731 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-19fd2678-56de-4300-8d4d-c054585aae38 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:36:37.509965 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-19fd2678-56de-4300-8d4d-c054585aae38 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52" status: 200 len: 1724 microversion: 2.20 time: 0.166977 May 19 13:36:37.510737 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 300/617] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:36:37 2022] GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:36:38.116494 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-83909769-0d3f-423f-88b9-351f0f4caaba tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:36:38.117232 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-83909769-0d3f-423f-88b9-351f0f4caaba tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: bb839e22-971b-4313-be06-20e09838215a] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:36:38.123749 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-83909769-0d3f-423f-88b9-351f0f4caaba tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:38.124309 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-83909769-0d3f-423f-88b9-351f0f4caaba tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:38.125067 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-83909769-0d3f-423f-88b9-351f0f4caaba tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:38.125613 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-83909769-0d3f-423f-88b9-351f0f4caaba tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:38.266856 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-83909769-0d3f-423f-88b9-351f0f4caaba tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:36:38.275122 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-83909769-0d3f-423f-88b9-351f0f4caaba tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a" status: 200 len: 1508 microversion: 2.1 time: 0.163460 May 19 13:36:38.275694 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 318/618] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:36:38 2022] GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a => generated 1508 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:36:38.529785 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-ee4171fa-7c30-48c3-84a8-20ed523c2394 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:36:38.530389 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-ee4171fa-7c30-48c3-84a8-20ed523c2394 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 8ea882c7-9191-4712-91eb-a810e49b9e52] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:36:38.538257 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-ee4171fa-7c30-48c3-84a8-20ed523c2394 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:38.538700 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-ee4171fa-7c30-48c3-84a8-20ed523c2394 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:38.539472 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-ee4171fa-7c30-48c3-84a8-20ed523c2394 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:38.539900 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-ee4171fa-7c30-48c3-84a8-20ed523c2394 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:38.765970 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-ee4171fa-7c30-48c3-84a8-20ed523c2394 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:36:38.780097 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-ee4171fa-7c30-48c3-84a8-20ed523c2394 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:36:38.784366 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-ee4171fa-7c30-48c3-84a8-20ed523c2394 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:36:38.785661 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-ee4171fa-7c30-48c3-84a8-20ed523c2394 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52" status: 200 len: 1724 microversion: 2.20 time: 0.259789 May 19 13:36:38.786790 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 301/619] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:36:38 2022] GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52 => generated 1724 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:36:38.844924 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [req-a87b6308-7d00-495c-adf5-1b934fd4dd49 req-2593c375-73bd-43c5-bb0f-fd2e16589ae5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb839e22-971b-4313-be06-20e09838215a", "name": "network-vif-deleted", "tag": "ea2cc4f1-cac0-4395-b583-23d210e4ca9b"}]} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:36:38.855284 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-a87b6308-7d00-495c-adf5-1b934fd4dd49 req-2593c375-73bd-43c5-bb0f-fd2e16589ae5 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:38.855762 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-a87b6308-7d00-495c-adf5-1b934fd4dd49 req-2593c375-73bd-43c5-bb0f-fd2e16589ae5 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:38.875894 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.compute.server_external_events [req-a87b6308-7d00-495c-adf5-1b934fd4dd49 req-2593c375-73bd-43c5-bb0f-fd2e16589ae5 service nova] Creating event network-vif-deleted:ea2cc4f1-cac0-4395-b583-23d210e4ca9b for instance bb839e22-971b-4313-be06-20e09838215a on hv-cinder-84112 May 19 13:36:38.881535 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [req-a87b6308-7d00-495c-adf5-1b934fd4dd49 req-2593c375-73bd-43c5-bb0f-fd2e16589ae5 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040942 May 19 13:36:38.882402 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 319/620] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:36:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:36:39.295823 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-3db39452-07d7-4cbe-ab22-22873dc45938 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:36:39.296656 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-3db39452-07d7-4cbe-ab22-22873dc45938 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: bb839e22-971b-4313-be06-20e09838215a] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:36:39.304855 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-3db39452-07d7-4cbe-ab22-22873dc45938 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:39.305321 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-3db39452-07d7-4cbe-ab22-22873dc45938 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:39.306094 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-3db39452-07d7-4cbe-ab22-22873dc45938 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:39.306527 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-3db39452-07d7-4cbe-ab22-22873dc45938 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:39.339431 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-3db39452-07d7-4cbe-ab22-22873dc45938 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:39.339892 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-3db39452-07d7-4cbe-ab22-22873dc45938 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:39.340327 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.objects.instance [None req-3db39452-07d7-4cbe-ab22-22873dc45938 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lazy-loading 'fault' on Instance uuid bb839e22-971b-4313-be06-20e09838215a {{(pid=120472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 13:36:39.386857 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-3db39452-07d7-4cbe-ab22-22873dc45938 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:36:39.395416 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-3db39452-07d7-4cbe-ab22-22873dc45938 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a" status: 200 len: 1312 microversion: 2.1 time: 0.105668 May 19 13:36:39.395810 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 302/621] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:36:39 2022] GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a => generated 1312 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:36:39.807343 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-1c2a52cb-8135-4f8f-9056-52d7a514e926 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:36:39.807903 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-1c2a52cb-8135-4f8f-9056-52d7a514e926 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 8ea882c7-9191-4712-91eb-a810e49b9e52] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:36:39.815100 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-1c2a52cb-8135-4f8f-9056-52d7a514e926 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:39.815523 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-1c2a52cb-8135-4f8f-9056-52d7a514e926 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:39.816297 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-1c2a52cb-8135-4f8f-9056-52d7a514e926 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:39.816722 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-1c2a52cb-8135-4f8f-9056-52d7a514e926 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:39.955874 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-1c2a52cb-8135-4f8f-9056-52d7a514e926 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:36:39.963863 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-1c2a52cb-8135-4f8f-9056-52d7a514e926 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:36:39.965401 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-1c2a52cb-8135-4f8f-9056-52d7a514e926 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:36:39.966602 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-1c2a52cb-8135-4f8f-9056-52d7a514e926 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52" status: 200 len: 1724 microversion: 2.20 time: 0.164239 May 19 13:36:39.967150 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 320/622] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:36:39 2022] GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:36:40.414942 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-9d04e82c-7526-4cab-96ed-2b8e3c056f7a tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:36:40.415682 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-9d04e82c-7526-4cab-96ed-2b8e3c056f7a tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: bb839e22-971b-4313-be06-20e09838215a] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:36:40.423377 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-9d04e82c-7526-4cab-96ed-2b8e3c056f7a tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:40.423813 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-9d04e82c-7526-4cab-96ed-2b8e3c056f7a tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:40.424571 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-9d04e82c-7526-4cab-96ed-2b8e3c056f7a tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:40.424996 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-9d04e82c-7526-4cab-96ed-2b8e3c056f7a tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:40.438978 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.wsgi [None req-9d04e82c-7526-4cab-96ed-2b8e3c056f7a tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] HTTP exception thrown: Instance bb839e22-971b-4313-be06-20e09838215a could not be found. May 19 13:36:40.440772 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-9d04e82c-7526-4cab-96ed-2b8e3c056f7a tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Request method failure captured: May 19 13:36:40.440772 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: request: GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a HTTP/1.1 May 19 13:36:40.440772 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Accept: application/json May 19 13:36:40.440772 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Accept-Encoding: identity May 19 13:36:40.440772 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Connection: close May 19 13:36:40.440772 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Content-Length: 0 May 19 13:36:40.440772 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Content-Type: application/json May 19 13:36:40.440772 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Host: 10.222.0.24 May 19 13:36:40.440772 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Openstack-System-Scope: None May 19 13:36:40.440772 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: User-Agent: python-urllib3/1.26.9 May 19 13:36:40.440772 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Auth-Token: gAAAAABihka28w_XrUfaOtaJo3uOu_VKP25qoARCt1sMNKJyTv9Zs2UdBFAMxpQQTuZSPm5_OGrEsu9-FHYT7rVvy0PjGuvfYySPIV0FbQR2CrL-a-e1bGrkGoxusbmks-C9euLBSRZS_Ru4AaJkLiaaCt15rraZYv-Ku8n3RqspqC_JYm_SeyE May 19 13:36:40.440772 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Domain-Id: None May 19 13:36:40.440772 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Domain-Name: None May 19 13:36:40.440772 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Identity-Status: Confirmed May 19 13:36:40.440772 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Is-Admin-Project: True May 19 13:36:40.440772 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Domain-Id: default May 19 13:36:40.440772 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Domain-Name: Default May 19 13:36:40.440772 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Id: 63972a518bb048d19dd070eb9ac85445 May 19 13:36:40.440772 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-217359763 May 19 13:36:40.440772 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Role: reader,member May 19 13:36:40.440772 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Roles: reader,member May 19 13:36:40.442416 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/63972a518bb048d19dd070eb9ac85445"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/63972a518bb048d19dd070eb9ac85445"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_63972a518bb048d19dd070eb9ac85445", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/63972a518bb048d19dd070eb9ac85445"}]}] May 19 13:36:40.442416 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant: tempest-ServerRescueNegativeTestJSON-217359763 May 19 13:36:40.442416 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant-Id: 63972a518bb048d19dd070eb9ac85445 May 19 13:36:40.442416 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-217359763 May 19 13:36:40.442416 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User: tempest-ServerRescueNegativeTestJSON-217359763-project May 19 13:36:40.442416 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Domain-Id: default May 19 13:36:40.442416 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Domain-Name: Default May 19 13:36:40.442416 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Id: 2d3b91bfd0304cc793e3ad52c9b9e865 May 19 13:36:40.442416 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Name: tempest-ServerRescueNegativeTestJSON-217359763-project May 19 13:36:40.442416 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: method: > May 19 13:36:40.442416 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: exception: Instance bb839e22-971b-4313-be06-20e09838215a could not be found. May 19 13:36:40.442416 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: action_args: {'id': 'bb839e22-971b-4313-be06-20e09838215a'} May 19 13:36:40.443179 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:36:40.443179 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:36:40.443179 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 13:36:40.443179 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 13:36:40.443179 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 13:36:40.443179 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 13:36:40.443179 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 13:36:40.443179 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 13:36:40.443179 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 13:36:40.443179 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 13:36:40.443179 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb839e22-971b-4313-be06-20e09838215a could not be found. May 19 13:36:40.443179 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:36:40.443179 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:36:40.443179 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:36:40.443179 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:36:40.443179 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:36:40.443179 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:36:40.443179 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:36:40.443179 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:36:40.443179 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:36:40.444374 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:36:40.444374 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 13:36:40.444374 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 13:36:40.444374 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 13:36:40.444374 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 13:36:40.444374 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 13:36:40.444374 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 13:36:40.444374 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb839e22-971b-4313-be06-20e09838215a could not be found. May 19 13:36:40.444374 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:36:40.444374 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:36:40.444374 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:36:40.444374 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:36:40.444374 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:36:40.444374 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:36:40.444374 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:36:40.444374 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:36:40.444374 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb839e22-971b-4313-be06-20e09838215a could not be found. May 19 13:36:40.444374 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:36:40.445488 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-9d04e82c-7526-4cab-96ed-2b8e3c056f7a tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Returning 404 to user: Instance bb839e22-971b-4313-be06-20e09838215a could not be found. {{(pid=120472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:36:40.445488 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-9d04e82c-7526-4cab-96ed-2b8e3c056f7a tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a" status: 404 len: 111 microversion: 2.1 time: 0.032115 May 19 13:36:40.445488 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 303/623] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:36:40 2022] GET /compute/v2.1/servers/bb839e22-971b-4313-be06-20e09838215a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 13:36:40.450982 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-651ff227-97a4-4449-8476-678cd97cb7e0 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:36:40.451468 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-651ff227-97a4-4449-8476-678cd97cb7e0 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: c4c1abc9-8651-4788-9650-27704ae7e306] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:36:40.458078 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-651ff227-97a4-4449-8476-678cd97cb7e0 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:40.458525 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-651ff227-97a4-4449-8476-678cd97cb7e0 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:40.459391 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-651ff227-97a4-4449-8476-678cd97cb7e0 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:40.459902 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-651ff227-97a4-4449-8476-678cd97cb7e0 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:40.485675 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-651ff227-97a4-4449-8476-678cd97cb7e0 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: c4c1abc9-8651-4788-9650-27704ae7e306] Going to try to terminate instance {{(pid=120471) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 13:36:40.570185 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-651ff227-97a4-4449-8476-678cd97cb7e0 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "DELETE /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306" status: 204 len: 0 microversion: 2.1 time: 0.122567 May 19 13:36:40.571093 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 321/624] 10.222.0.24 () {58 vars in 1238 bytes} [Thu May 19 13:36:40 2022] DELETE /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 19 13:36:40.579451 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-1f7597bb-6090-4f00-a604-e113f4f71bed tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:36:40.580256 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-1f7597bb-6090-4f00-a604-e113f4f71bed tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: c4c1abc9-8651-4788-9650-27704ae7e306] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:36:40.582291 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_cell0:SELECT=4 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:36:40.587778 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-1f7597bb-6090-4f00-a604-e113f4f71bed tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:40.588217 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-1f7597bb-6090-4f00-a604-e113f4f71bed tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:40.588966 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-1f7597bb-6090-4f00-a604-e113f4f71bed tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:40.589393 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-1f7597bb-6090-4f00-a604-e113f4f71bed tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:40.720717 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-1f7597bb-6090-4f00-a604-e113f4f71bed tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:36:40.729064 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-1f7597bb-6090-4f00-a604-e113f4f71bed tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306" status: 200 len: 1520 microversion: 2.1 time: 0.153588 May 19 13:36:40.729665 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 304/625] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:36:40 2022] GET /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:36:40.985851 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-0fe5eb45-eef6-47f0-91e4-92dac96a2d2d tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:36:40.986581 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-0fe5eb45-eef6-47f0-91e4-92dac96a2d2d tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 8ea882c7-9191-4712-91eb-a810e49b9e52] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:36:40.993458 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-0fe5eb45-eef6-47f0-91e4-92dac96a2d2d tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:40.993941 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-0fe5eb45-eef6-47f0-91e4-92dac96a2d2d tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:40.994706 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-0fe5eb45-eef6-47f0-91e4-92dac96a2d2d tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:40.995141 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-0fe5eb45-eef6-47f0-91e4-92dac96a2d2d tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:41.136585 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-0fe5eb45-eef6-47f0-91e4-92dac96a2d2d tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:36:41.145704 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-0fe5eb45-eef6-47f0-91e4-92dac96a2d2d tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:36:41.147309 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-0fe5eb45-eef6-47f0-91e4-92dac96a2d2d tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:36:41.148509 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-0fe5eb45-eef6-47f0-91e4-92dac96a2d2d tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52" status: 200 len: 1724 microversion: 2.20 time: 0.167457 May 19 13:36:41.149077 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 322/626] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:36:40 2022] GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:36:41.747123 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-2842203a-ae1f-4432-9e63-9171788bd5ab tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:36:41.747724 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-2842203a-ae1f-4432-9e63-9171788bd5ab tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: c4c1abc9-8651-4788-9650-27704ae7e306] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:36:41.754898 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-2842203a-ae1f-4432-9e63-9171788bd5ab tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:41.755339 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-2842203a-ae1f-4432-9e63-9171788bd5ab tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:41.756112 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-2842203a-ae1f-4432-9e63-9171788bd5ab tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:41.756508 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-2842203a-ae1f-4432-9e63-9171788bd5ab tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:41.904349 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-2842203a-ae1f-4432-9e63-9171788bd5ab tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:36:41.912261 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-2842203a-ae1f-4432-9e63-9171788bd5ab tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306" status: 200 len: 1520 microversion: 2.1 time: 0.169027 May 19 13:36:41.912814 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 305/627] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:36:41 2022] GET /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:36:42.168612 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-c5cca46f-f226-4a9d-b773-13679681c713 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:36:42.169613 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-c5cca46f-f226-4a9d-b773-13679681c713 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 8ea882c7-9191-4712-91eb-a810e49b9e52] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:36:42.177056 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-c5cca46f-f226-4a9d-b773-13679681c713 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:42.177547 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-c5cca46f-f226-4a9d-b773-13679681c713 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:42.178316 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-c5cca46f-f226-4a9d-b773-13679681c713 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:42.178749 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-c5cca46f-f226-4a9d-b773-13679681c713 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:42.197655 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:36:42.319924 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-c5cca46f-f226-4a9d-b773-13679681c713 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:36:42.327960 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-c5cca46f-f226-4a9d-b773-13679681c713 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:36:42.329558 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-c5cca46f-f226-4a9d-b773-13679681c713 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:36:42.330846 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-c5cca46f-f226-4a9d-b773-13679681c713 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52" status: 200 len: 1724 microversion: 2.20 time: 0.166681 May 19 13:36:42.331367 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 323/628] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:36:42 2022] GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:36:42.932160 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-13fad563-c29d-4282-ab44-21ab7ce03377 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:36:42.932713 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-13fad563-c29d-4282-ab44-21ab7ce03377 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: c4c1abc9-8651-4788-9650-27704ae7e306] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:36:42.939927 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-13fad563-c29d-4282-ab44-21ab7ce03377 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:42.940398 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-13fad563-c29d-4282-ab44-21ab7ce03377 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:42.941147 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-13fad563-c29d-4282-ab44-21ab7ce03377 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:42.941600 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-13fad563-c29d-4282-ab44-21ab7ce03377 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:42.961123 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:36:43.084408 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-13fad563-c29d-4282-ab44-21ab7ce03377 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:36:43.092408 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-13fad563-c29d-4282-ab44-21ab7ce03377 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306" status: 200 len: 1520 microversion: 2.1 time: 0.165919 May 19 13:36:43.092968 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 306/629] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:36:42 2022] GET /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:36:43.356495 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-2f0a5d33-ba3a-4bdf-92b9-14f609fbb057 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:36:43.357095 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-2f0a5d33-ba3a-4bdf-92b9-14f609fbb057 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 8ea882c7-9191-4712-91eb-a810e49b9e52] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:36:43.365662 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-2f0a5d33-ba3a-4bdf-92b9-14f609fbb057 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:43.366288 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-2f0a5d33-ba3a-4bdf-92b9-14f609fbb057 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:43.367465 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-2f0a5d33-ba3a-4bdf-92b9-14f609fbb057 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:43.368084 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-2f0a5d33-ba3a-4bdf-92b9-14f609fbb057 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:43.502762 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-2f0a5d33-ba3a-4bdf-92b9-14f609fbb057 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:36:43.511013 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-2f0a5d33-ba3a-4bdf-92b9-14f609fbb057 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:36:43.512506 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-2f0a5d33-ba3a-4bdf-92b9-14f609fbb057 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:36:43.513677 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-2f0a5d33-ba3a-4bdf-92b9-14f609fbb057 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52" status: 200 len: 1724 microversion: 2.20 time: 0.162836 May 19 13:36:43.514204 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 324/630] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:36:43 2022] GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:36:44.110986 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-1a762648-4498-420e-b599-3ada3ee809ed tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:36:44.111711 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-1a762648-4498-420e-b599-3ada3ee809ed tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: c4c1abc9-8651-4788-9650-27704ae7e306] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:36:44.118226 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-1a762648-4498-420e-b599-3ada3ee809ed tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:44.118753 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-1a762648-4498-420e-b599-3ada3ee809ed tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:44.119576 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-1a762648-4498-420e-b599-3ada3ee809ed tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:44.120061 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-1a762648-4498-420e-b599-3ada3ee809ed tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:44.337363 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-1a762648-4498-420e-b599-3ada3ee809ed tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3b91bfd0304cc793e3ad52c9b9e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63972a518bb048d19dd070eb9ac85445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:36:44.345650 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-1a762648-4498-420e-b599-3ada3ee809ed tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306" status: 200 len: 1520 microversion: 2.1 time: 0.238333 May 19 13:36:44.346402 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 307/631] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:36:44 2022] GET /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306 => generated 1520 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:36:44.511513 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [req-373cac51-63e5-4108-98a0-bbe13088d835 req-e9bdbede-e19c-4655-9680-a04a6a89eed5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4c1abc9-8651-4788-9650-27704ae7e306", "name": "network-vif-deleted", "tag": "700b033c-2fd5-4b02-a577-7fa27ba29508"}]} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:36:44.520253 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-373cac51-63e5-4108-98a0-bbe13088d835 req-e9bdbede-e19c-4655-9680-a04a6a89eed5 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:44.520733 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-373cac51-63e5-4108-98a0-bbe13088d835 req-e9bdbede-e19c-4655-9680-a04a6a89eed5 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:44.531465 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-8cb08653-4583-40e4-bccf-1fb3d66f0e09 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:36:44.532184 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-8cb08653-4583-40e4-bccf-1fb3d66f0e09 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 8ea882c7-9191-4712-91eb-a810e49b9e52] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:36:44.534435 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.compute.server_external_events [req-373cac51-63e5-4108-98a0-bbe13088d835 req-e9bdbede-e19c-4655-9680-a04a6a89eed5 service nova] Creating event network-vif-deleted:700b033c-2fd5-4b02-a577-7fa27ba29508 for instance c4c1abc9-8651-4788-9650-27704ae7e306 on hv-cinder-84112 May 19 13:36:44.538847 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-8cb08653-4583-40e4-bccf-1fb3d66f0e09 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:44.539482 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-8cb08653-4583-40e4-bccf-1fb3d66f0e09 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:44.539662 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [req-373cac51-63e5-4108-98a0-bbe13088d835 req-e9bdbede-e19c-4655-9680-a04a6a89eed5 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032017 May 19 13:36:44.540247 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-8cb08653-4583-40e4-bccf-1fb3d66f0e09 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:44.540435 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 325/632] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:36:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 13:36:44.540990 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-8cb08653-4583-40e4-bccf-1fb3d66f0e09 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:44.698287 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-8cb08653-4583-40e4-bccf-1fb3d66f0e09 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:36:44.706450 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-8cb08653-4583-40e4-bccf-1fb3d66f0e09 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:36:44.707984 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-8cb08653-4583-40e4-bccf-1fb3d66f0e09 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:36:44.709154 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-8cb08653-4583-40e4-bccf-1fb3d66f0e09 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52" status: 200 len: 1724 microversion: 2.20 time: 0.181553 May 19 13:36:44.709748 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 308/633] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:36:44 2022] GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52 => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 13:36:45.367146 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-47d70c2b-ca6c-40f8-9e30-49294c7fa034 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:36:45.368328 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-47d70c2b-ca6c-40f8-9e30-49294c7fa034 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] [instance: c4c1abc9-8651-4788-9650-27704ae7e306] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:36:45.378240 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-47d70c2b-ca6c-40f8-9e30-49294c7fa034 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:45.378702 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-47d70c2b-ca6c-40f8-9e30-49294c7fa034 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:45.379484 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-47d70c2b-ca6c-40f8-9e30-49294c7fa034 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:45.379918 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-47d70c2b-ca6c-40f8-9e30-49294c7fa034 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:45.398844 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.wsgi [None req-47d70c2b-ca6c-40f8-9e30-49294c7fa034 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] HTTP exception thrown: Instance c4c1abc9-8651-4788-9650-27704ae7e306 could not be found. May 19 13:36:45.400507 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-47d70c2b-ca6c-40f8-9e30-49294c7fa034 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Request method failure captured: May 19 13:36:45.400507 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: request: GET /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306 HTTP/1.1 May 19 13:36:45.400507 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Accept: application/json May 19 13:36:45.400507 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Accept-Encoding: identity May 19 13:36:45.400507 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Connection: close May 19 13:36:45.400507 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Content-Length: 0 May 19 13:36:45.400507 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Content-Type: application/json May 19 13:36:45.400507 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Host: 10.222.0.24 May 19 13:36:45.400507 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Openstack-System-Scope: None May 19 13:36:45.400507 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: User-Agent: python-urllib3/1.26.9 May 19 13:36:45.400507 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Auth-Token: gAAAAABihka28w_XrUfaOtaJo3uOu_VKP25qoARCt1sMNKJyTv9Zs2UdBFAMxpQQTuZSPm5_OGrEsu9-FHYT7rVvy0PjGuvfYySPIV0FbQR2CrL-a-e1bGrkGoxusbmks-C9euLBSRZS_Ru4AaJkLiaaCt15rraZYv-Ku8n3RqspqC_JYm_SeyE May 19 13:36:45.400507 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Domain-Id: None May 19 13:36:45.400507 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Domain-Name: None May 19 13:36:45.400507 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Identity-Status: Confirmed May 19 13:36:45.400507 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Is-Admin-Project: True May 19 13:36:45.400507 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Domain-Id: default May 19 13:36:45.400507 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Domain-Name: Default May 19 13:36:45.400507 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Id: 63972a518bb048d19dd070eb9ac85445 May 19 13:36:45.400507 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-217359763 May 19 13:36:45.400507 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Role: reader,member May 19 13:36:45.400507 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Roles: reader,member May 19 13:36:45.401973 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/63972a518bb048d19dd070eb9ac85445"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/63972a518bb048d19dd070eb9ac85445"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_63972a518bb048d19dd070eb9ac85445", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/63972a518bb048d19dd070eb9ac85445"}]}] May 19 13:36:45.401973 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Tenant: tempest-ServerRescueNegativeTestJSON-217359763 May 19 13:36:45.401973 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Tenant-Id: 63972a518bb048d19dd070eb9ac85445 May 19 13:36:45.401973 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-217359763 May 19 13:36:45.401973 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User: tempest-ServerRescueNegativeTestJSON-217359763-project May 19 13:36:45.401973 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Domain-Id: default May 19 13:36:45.401973 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Domain-Name: Default May 19 13:36:45.401973 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Id: 2d3b91bfd0304cc793e3ad52c9b9e865 May 19 13:36:45.401973 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Name: tempest-ServerRescueNegativeTestJSON-217359763-project May 19 13:36:45.401973 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: method: > May 19 13:36:45.401973 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: exception: Instance c4c1abc9-8651-4788-9650-27704ae7e306 could not be found. May 19 13:36:45.401973 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: action_args: {'id': 'c4c1abc9-8651-4788-9650-27704ae7e306'} May 19 13:36:45.402729 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:36:45.402729 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:36:45.402729 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 13:36:45.402729 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 13:36:45.402729 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 13:36:45.402729 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 13:36:45.402729 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 13:36:45.402729 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 13:36:45.402729 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 13:36:45.402729 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 13:36:45.402729 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4c1abc9-8651-4788-9650-27704ae7e306 could not be found. May 19 13:36:45.402729 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:36:45.402729 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:36:45.402729 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:36:45.402729 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:36:45.402729 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:36:45.402729 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:36:45.402729 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:36:45.402729 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:36:45.402729 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:36:45.403983 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:36:45.403983 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 13:36:45.403983 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 13:36:45.403983 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 13:36:45.403983 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 13:36:45.403983 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 13:36:45.403983 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 13:36:45.403983 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4c1abc9-8651-4788-9650-27704ae7e306 could not be found. May 19 13:36:45.403983 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:36:45.403983 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:36:45.403983 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:36:45.403983 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:36:45.403983 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:36:45.403983 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:36:45.403983 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:36:45.403983 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:36:45.403983 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4c1abc9-8651-4788-9650-27704ae7e306 could not be found. May 19 13:36:45.403983 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:36:45.405324 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-47d70c2b-ca6c-40f8-9e30-49294c7fa034 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] Returning 404 to user: Instance c4c1abc9-8651-4788-9650-27704ae7e306 could not be found. {{(pid=120471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:36:45.405324 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-47d70c2b-ca6c-40f8-9e30-49294c7fa034 tempest-ServerRescueNegativeTestJSON-217359763 tempest-ServerRescueNegativeTestJSON-217359763-project] 10.222.0.24 "GET /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306" status: 404 len: 111 microversion: 2.1 time: 0.040827 May 19 13:36:45.405324 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 326/634] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:36:45 2022] GET /compute/v2.1/servers/c4c1abc9-8651-4788-9650-27704ae7e306 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 13:36:45.728291 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-5cebfa09-8672-4a36-9251-1f11363dfa98 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:36:45.729217 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-5cebfa09-8672-4a36-9251-1f11363dfa98 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 8ea882c7-9191-4712-91eb-a810e49b9e52] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:36:45.737896 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-5cebfa09-8672-4a36-9251-1f11363dfa98 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:45.738336 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-5cebfa09-8672-4a36-9251-1f11363dfa98 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:45.739113 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-5cebfa09-8672-4a36-9251-1f11363dfa98 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:45.739532 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-5cebfa09-8672-4a36-9251-1f11363dfa98 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:45.871647 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-5cebfa09-8672-4a36-9251-1f11363dfa98 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:36:45.881911 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-5cebfa09-8672-4a36-9251-1f11363dfa98 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:36:45.883402 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-5cebfa09-8672-4a36-9251-1f11363dfa98 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:36:45.884530 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-5cebfa09-8672-4a36-9251-1f11363dfa98 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52" status: 200 len: 1724 microversion: 2.20 time: 0.160652 May 19 13:36:45.885107 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 309/635] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:36:45 2022] GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:36:46.903317 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-d672bc5b-2224-4516-8c0d-7a59b0d7c14a tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:36:46.903886 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-d672bc5b-2224-4516-8c0d-7a59b0d7c14a tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 8ea882c7-9191-4712-91eb-a810e49b9e52] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:36:46.911078 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-d672bc5b-2224-4516-8c0d-7a59b0d7c14a tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:46.911611 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-d672bc5b-2224-4516-8c0d-7a59b0d7c14a tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:46.912576 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-d672bc5b-2224-4516-8c0d-7a59b0d7c14a tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:46.913188 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-d672bc5b-2224-4516-8c0d-7a59b0d7c14a tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:47.056210 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-d672bc5b-2224-4516-8c0d-7a59b0d7c14a tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:36:47.064975 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-d672bc5b-2224-4516-8c0d-7a59b0d7c14a tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:36:47.066635 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-d672bc5b-2224-4516-8c0d-7a59b0d7c14a tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:36:47.067838 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-d672bc5b-2224-4516-8c0d-7a59b0d7c14a tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52" status: 200 len: 1724 microversion: 2.20 time: 0.168672 May 19 13:36:47.068700 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 327/636] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:36:46 2022] GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:36:48.087492 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-6bc8c6ef-e812-46d2-8bc3-86d9acc6b8f2 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:36:48.088251 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-6bc8c6ef-e812-46d2-8bc3-86d9acc6b8f2 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 8ea882c7-9191-4712-91eb-a810e49b9e52] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:36:48.094881 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-6bc8c6ef-e812-46d2-8bc3-86d9acc6b8f2 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:48.095318 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-6bc8c6ef-e812-46d2-8bc3-86d9acc6b8f2 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:48.096081 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-6bc8c6ef-e812-46d2-8bc3-86d9acc6b8f2 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:48.096507 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-6bc8c6ef-e812-46d2-8bc3-86d9acc6b8f2 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:48.312030 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-6bc8c6ef-e812-46d2-8bc3-86d9acc6b8f2 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:36:48.322003 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-6bc8c6ef-e812-46d2-8bc3-86d9acc6b8f2 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:36:48.323513 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-6bc8c6ef-e812-46d2-8bc3-86d9acc6b8f2 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:36:48.324777 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-6bc8c6ef-e812-46d2-8bc3-86d9acc6b8f2 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52" status: 200 len: 1724 microversion: 2.20 time: 0.242200 May 19 13:36:48.325438 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 310/637] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:36:48 2022] GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52 => generated 1724 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:36:48.545273 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-5296b396-ac10-49c6-807b-7cb385c4bdcd tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-473779853", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1595031897", "security_groups": [{"name": "tempest-secgroup-smoke-1083232826"}], "block_device_mapping_v2": [{"uuid": "b467a66b-b05c-4acb-ba6d-2e7d84aa24dd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "43f56851-7e12-4789-85bf-4f3ea4d4394d"}]}} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:36:48.697797 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.network.neutron [None req-5296b396-ac10-49c6-807b-7cb385c4bdcd tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] validate_networks() for [('43f56851-7e12-4789-85bf-4f3ea4d4394d', None, None, None, None, None)] {{(pid=120471) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 13:36:49.278260 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.virt.hardware [None req-5296b396-ac10-49c6-807b-7cb385c4bdcd tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Flavor limits 0:0:0 {{(pid=120471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 13:36:49.278976 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.virt.hardware [None req-5296b396-ac10-49c6-807b-7cb385c4bdcd tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Image limits 0:0:0 {{(pid=120471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 13:36:49.279711 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.virt.hardware [None req-5296b396-ac10-49c6-807b-7cb385c4bdcd tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Flavor pref 0:0:0 {{(pid=120471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 13:36:49.280373 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.virt.hardware [None req-5296b396-ac10-49c6-807b-7cb385c4bdcd tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Image pref 0:0:0 {{(pid=120471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 13:36:49.281034 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.virt.hardware [None req-5296b396-ac10-49c6-807b-7cb385c4bdcd tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 13:36:49.294375 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-5296b396-ac10-49c6-807b-7cb385c4bdcd tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:49.295186 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-5296b396-ac10-49c6-807b-7cb385c4bdcd tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:49.296391 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-5296b396-ac10-49c6-807b-7cb385c4bdcd tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:49.297233 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-5296b396-ac10-49c6-807b-7cb385c4bdcd tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:49.320770 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.quota [None req-5296b396-ac10-49c6-807b-7cb385c4bdcd tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Getting quotas for project 98ad7b921dbc4a8d9e9be0d50385deee. Resources: {'instances', 'cores', 'ram'} {{(pid=120471) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 13:36:49.325708 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.quota [None req-5296b396-ac10-49c6-807b-7cb385c4bdcd tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Getting quotas for user aa0a4b41707d444581ee0aa2296ac0ba and project 98ad7b921dbc4a8d9e9be0d50385deee. Resources: {'instances', 'cores', 'ram'} {{(pid=120471) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 13:36:49.344864 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-9b89775f-fa89-4e9a-9fd9-445c13d0d36d tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:36:49.347156 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-9b89775f-fa89-4e9a-9fd9-445c13d0d36d tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 8ea882c7-9191-4712-91eb-a810e49b9e52] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:36:49.354762 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-9b89775f-fa89-4e9a-9fd9-445c13d0d36d tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:49.355650 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-9b89775f-fa89-4e9a-9fd9-445c13d0d36d tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:49.356954 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-9b89775f-fa89-4e9a-9fd9-445c13d0d36d tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:49.357383 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-9b89775f-fa89-4e9a-9fd9-445c13d0d36d tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:49.399350 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-5296b396-ac10-49c6-807b-7cb385c4bdcd tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Going to run 1 instances... {{(pid=120471) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 13:36:49.402037 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-5296b396-ac10-49c6-807b-7cb385c4bdcd tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] [instance: 9ffb3760-1c38-48de-abb9-ac0e14389d8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b467a66b-b05c-4acb-ba6d-2e7d84aa24dd',volume_size=None,volume_type=None)] {{(pid=120471) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 13:36:49.523190 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-9b89775f-fa89-4e9a-9fd9-445c13d0d36d tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:36:49.531530 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-9b89775f-fa89-4e9a-9fd9-445c13d0d36d tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:36:49.533374 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-9b89775f-fa89-4e9a-9fd9-445c13d0d36d tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:36:49.534562 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-9b89775f-fa89-4e9a-9fd9-445c13d0d36d tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52" status: 200 len: 1724 microversion: 2.20 time: 0.195336 May 19 13:36:49.535154 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 311/638] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:36:49 2022] GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52 => generated 1724 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:36:49.572239 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-5296b396-ac10-49c6-807b-7cb385c4bdcd tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.031068 May 19 13:36:49.573569 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 328/639] 10.222.0.24 () {60 vars in 1146 bytes} [Thu May 19 13:36:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 1033 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 19 13:36:49.583291 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-82dee478-7dcb-485e-ac04-5a5629391d0d tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:36:49.583891 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-82dee478-7dcb-485e-ac04-5a5629391d0d tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] [instance: 9ffb3760-1c38-48de-abb9-ac0e14389d8f] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:36:49.644556 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-82dee478-7dcb-485e-ac04-5a5629391d0d tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0a4b41707d444581ee0aa2296ac0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ad7b921dbc4a8d9e9be0d50385deee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:36:49.652554 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-82dee478-7dcb-485e-ac04-5a5629391d0d tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] 10.222.0.24 "GET /compute/v2.1/servers/9ffb3760-1c38-48de-abb9-ac0e14389d8f" status: 200 len: 1094 microversion: 2.1 time: 0.073429 May 19 13:36:49.654308 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 312/640] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:36:49 2022] GET /compute/v2.1/servers/9ffb3760-1c38-48de-abb9-ac0e14389d8f => generated 1094 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:36:50.554179 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-83799963-9fdf-4c19-8529-cccbb41714b3 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:36:50.554877 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-83799963-9fdf-4c19-8529-cccbb41714b3 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 8ea882c7-9191-4712-91eb-a810e49b9e52] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:36:50.562662 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-83799963-9fdf-4c19-8529-cccbb41714b3 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:50.563011 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-83799963-9fdf-4c19-8529-cccbb41714b3 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:50.564181 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-83799963-9fdf-4c19-8529-cccbb41714b3 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:50.564631 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-83799963-9fdf-4c19-8529-cccbb41714b3 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:50.671496 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-69fe6488-28b5-49e6-9779-d77680f9b77e tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:36:50.672474 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-69fe6488-28b5-49e6-9779-d77680f9b77e tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] [instance: 9ffb3760-1c38-48de-abb9-ac0e14389d8f] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:36:50.680955 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-69fe6488-28b5-49e6-9779-d77680f9b77e tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:50.681345 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-69fe6488-28b5-49e6-9779-d77680f9b77e tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:50.682570 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-69fe6488-28b5-49e6-9779-d77680f9b77e tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:50.683078 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-69fe6488-28b5-49e6-9779-d77680f9b77e tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:50.711102 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-83799963-9fdf-4c19-8529-cccbb41714b3 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:36:50.726900 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-83799963-9fdf-4c19-8529-cccbb41714b3 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:36:50.728673 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-83799963-9fdf-4c19-8529-cccbb41714b3 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:36:50.730125 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-83799963-9fdf-4c19-8529-cccbb41714b3 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52" status: 200 len: 1724 microversion: 2.20 time: 0.180288 May 19 13:36:50.730685 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 329/641] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:36:50 2022] GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52 => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:36:50.771494 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-69fe6488-28b5-49e6-9779-d77680f9b77e tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0a4b41707d444581ee0aa2296ac0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ad7b921dbc4a8d9e9be0d50385deee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:36:50.780102 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-69fe6488-28b5-49e6-9779-d77680f9b77e tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] 10.222.0.24 "GET /compute/v2.1/servers/9ffb3760-1c38-48de-abb9-ac0e14389d8f" status: 200 len: 1192 microversion: 2.1 time: 0.112663 May 19 13:36:50.792717 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 313/642] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:36:50 2022] GET /compute/v2.1/servers/9ffb3760-1c38-48de-abb9-ac0e14389d8f => generated 1192 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:36:51.752754 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-43aaaa5d-933f-4577-803c-87256871d795 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:36:51.753346 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-43aaaa5d-933f-4577-803c-87256871d795 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 8ea882c7-9191-4712-91eb-a810e49b9e52] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:36:51.763628 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-43aaaa5d-933f-4577-803c-87256871d795 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:51.764077 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-43aaaa5d-933f-4577-803c-87256871d795 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:51.769612 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-43aaaa5d-933f-4577-803c-87256871d795 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:51.770069 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-43aaaa5d-933f-4577-803c-87256871d795 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:51.801139 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-fdd574d7-6f1c-4035-ab06-aaeb030b4bd0 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:36:51.802413 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-fdd574d7-6f1c-4035-ab06-aaeb030b4bd0 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] [instance: 9ffb3760-1c38-48de-abb9-ac0e14389d8f] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:36:51.812488 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-fdd574d7-6f1c-4035-ab06-aaeb030b4bd0 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:51.813382 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-fdd574d7-6f1c-4035-ab06-aaeb030b4bd0 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:51.815216 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-fdd574d7-6f1c-4035-ab06-aaeb030b4bd0 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:51.815983 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-fdd574d7-6f1c-4035-ab06-aaeb030b4bd0 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:52.128366 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-fdd574d7-6f1c-4035-ab06-aaeb030b4bd0 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0a4b41707d444581ee0aa2296ac0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ad7b921dbc4a8d9e9be0d50385deee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:36:52.141370 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-fdd574d7-6f1c-4035-ab06-aaeb030b4bd0 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] 10.222.0.24 "GET /compute/v2.1/servers/9ffb3760-1c38-48de-abb9-ac0e14389d8f" status: 200 len: 1278 microversion: 2.1 time: 0.344712 May 19 13:36:52.145862 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 314/643] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:36:51 2022] GET /compute/v2.1/servers/9ffb3760-1c38-48de-abb9-ac0e14389d8f => generated 1278 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:36:52.147077 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-43aaaa5d-933f-4577-803c-87256871d795 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:36:52.159531 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-43aaaa5d-933f-4577-803c-87256871d795 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:36:52.161156 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-43aaaa5d-933f-4577-803c-87256871d795 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:36:52.162644 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-43aaaa5d-933f-4577-803c-87256871d795 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52" status: 200 len: 1724 microversion: 2.20 time: 0.413866 May 19 13:36:52.163598 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 330/644] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:36:51 2022] GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52 => generated 1724 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:36:53.005588 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [req-43d5e625-00ba-4932-959d-a8e023179389 req-369ccf98-1704-4a22-965c-27c444c023e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ffb3760-1c38-48de-abb9-ac0e14389d8f", "tag": "dc294f75-6a16-4072-8363-f879c3f39838"}]} {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:36:53.021291 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [req-43d5e625-00ba-4932-959d-a8e023179389 req-369ccf98-1704-4a22-965c-27c444c023e4 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:53.024989 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [req-43d5e625-00ba-4932-959d-a8e023179389 req-369ccf98-1704-4a22-965c-27c444c023e4 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:53.043385 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.compute.server_external_events [req-43d5e625-00ba-4932-959d-a8e023179389 req-369ccf98-1704-4a22-965c-27c444c023e4 service nova] Creating event network-changed:dc294f75-6a16-4072-8363-f879c3f39838 for instance 9ffb3760-1c38-48de-abb9-ac0e14389d8f on hv-cinder-84112 May 19 13:36:53.051311 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [req-43d5e625-00ba-4932-959d-a8e023179389 req-369ccf98-1704-4a22-965c-27c444c023e4 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.258589 May 19 13:36:53.052197 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 315/645] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:36:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:36:53.163280 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-9fd084d2-9232-4cf2-96a8-a7b25f8c8bcc tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:36:53.164476 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-9fd084d2-9232-4cf2-96a8-a7b25f8c8bcc tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] [instance: 9ffb3760-1c38-48de-abb9-ac0e14389d8f] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:36:53.173365 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-9fd084d2-9232-4cf2-96a8-a7b25f8c8bcc tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:53.174231 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-9fd084d2-9232-4cf2-96a8-a7b25f8c8bcc tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:53.175401 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-9fd084d2-9232-4cf2-96a8-a7b25f8c8bcc tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:53.176124 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-9fd084d2-9232-4cf2-96a8-a7b25f8c8bcc tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:53.182753 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-ec7e3b87-4d82-42b2-a5d4-a07db96fd1c0 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:36:53.183447 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-ec7e3b87-4d82-42b2-a5d4-a07db96fd1c0 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 8ea882c7-9191-4712-91eb-a810e49b9e52] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:36:53.191501 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-ec7e3b87-4d82-42b2-a5d4-a07db96fd1c0 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:53.192220 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-ec7e3b87-4d82-42b2-a5d4-a07db96fd1c0 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:53.193665 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-ec7e3b87-4d82-42b2-a5d4-a07db96fd1c0 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:53.195470 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-ec7e3b87-4d82-42b2-a5d4-a07db96fd1c0 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:53.436624 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-9fd084d2-9232-4cf2-96a8-a7b25f8c8bcc tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0a4b41707d444581ee0aa2296ac0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ad7b921dbc4a8d9e9be0d50385deee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:36:53.445403 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-9fd084d2-9232-4cf2-96a8-a7b25f8c8bcc tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] 10.222.0.24 "GET /compute/v2.1/servers/9ffb3760-1c38-48de-abb9-ac0e14389d8f" status: 200 len: 1266 microversion: 2.1 time: 0.286129 May 19 13:36:53.448509 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 331/646] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:36:53 2022] GET /compute/v2.1/servers/9ffb3760-1c38-48de-abb9-ac0e14389d8f => generated 1266 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:36:53.502611 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-ec7e3b87-4d82-42b2-a5d4-a07db96fd1c0 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:36:53.519716 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-ec7e3b87-4d82-42b2-a5d4-a07db96fd1c0 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:36:53.521608 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-ec7e3b87-4d82-42b2-a5d4-a07db96fd1c0 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:36:53.523260 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-ec7e3b87-4d82-42b2-a5d4-a07db96fd1c0 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52" status: 200 len: 1724 microversion: 2.20 time: 0.344994 May 19 13:36:53.524692 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 316/647] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:36:53 2022] GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52 => generated 1724 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 13:36:54.466540 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-3793f0b2-a53f-4644-b1bc-1f3653561f39 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:36:54.467835 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-3793f0b2-a53f-4644-b1bc-1f3653561f39 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] [instance: 9ffb3760-1c38-48de-abb9-ac0e14389d8f] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:36:54.475807 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-3793f0b2-a53f-4644-b1bc-1f3653561f39 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:54.476624 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-3793f0b2-a53f-4644-b1bc-1f3653561f39 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:54.477668 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-3793f0b2-a53f-4644-b1bc-1f3653561f39 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:54.478320 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-3793f0b2-a53f-4644-b1bc-1f3653561f39 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:54.543687 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-7ef4c6ef-3c47-474a-aa9b-4235513c7267 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:36:54.545448 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-7ef4c6ef-3c47-474a-aa9b-4235513c7267 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 8ea882c7-9191-4712-91eb-a810e49b9e52] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:36:54.554071 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=2,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:36:54.556298 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-7ef4c6ef-3c47-474a-aa9b-4235513c7267 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:54.557214 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-7ef4c6ef-3c47-474a-aa9b-4235513c7267 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:54.558828 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-7ef4c6ef-3c47-474a-aa9b-4235513c7267 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:54.559438 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-7ef4c6ef-3c47-474a-aa9b-4235513c7267 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:54.719328 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-3793f0b2-a53f-4644-b1bc-1f3653561f39 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0a4b41707d444581ee0aa2296ac0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ad7b921dbc4a8d9e9be0d50385deee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:36:54.728172 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-3793f0b2-a53f-4644-b1bc-1f3653561f39 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] 10.222.0.24 "GET /compute/v2.1/servers/9ffb3760-1c38-48de-abb9-ac0e14389d8f" status: 200 len: 1266 microversion: 2.1 time: 0.266161 May 19 13:36:54.729468 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 332/648] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:36:54 2022] GET /compute/v2.1/servers/9ffb3760-1c38-48de-abb9-ac0e14389d8f => generated 1266 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:36:54.783439 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-7ef4c6ef-3c47-474a-aa9b-4235513c7267 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:36:54.791147 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-7ef4c6ef-3c47-474a-aa9b-4235513c7267 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:36:54.793047 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-7ef4c6ef-3c47-474a-aa9b-4235513c7267 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:36:54.794727 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-7ef4c6ef-3c47-474a-aa9b-4235513c7267 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52" status: 200 len: 1745 microversion: 2.20 time: 0.255744 May 19 13:36:54.795469 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 317/649] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:36:54 2022] GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52 => generated 1745 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:36:55.746157 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-939f8346-69df-4775-b51b-786ac4db5eb4 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:36:55.746762 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-939f8346-69df-4775-b51b-786ac4db5eb4 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] [instance: 9ffb3760-1c38-48de-abb9-ac0e14389d8f] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:36:55.750372 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:36:55.757066 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-939f8346-69df-4775-b51b-786ac4db5eb4 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:55.759931 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-939f8346-69df-4775-b51b-786ac4db5eb4 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:55.760850 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-939f8346-69df-4775-b51b-786ac4db5eb4 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:55.761295 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-939f8346-69df-4775-b51b-786ac4db5eb4 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:55.835694 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-f88fe052-ac79-4416-90f9-36c6db8a73cc tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Action: 'create', calling method: .version_select at 0x7f7c2a405d30>, body: {"keypair": {"name": "tempest-keypair-1063460404", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFxTSElXL5ZcTvAxJK/BzSUccfCgWLyFfvaTQw5u0CCCmxN5VLLieIYqmnaA7RCJBu519mGPoFNvVWbQxkomlc3xJWR1R8P/+U2FWjXFX9APymHnt21jyqazK//clO/zow=="}} {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:36:55.853347 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.quota [None req-f88fe052-ac79-4416-90f9-36c6db8a73cc tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Getting quotas for project b1222038740244f69a977fe658d9bfe0. Resources: {'key_pairs'} {{(pid=120472) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 13:36:55.857816 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.quota [None req-f88fe052-ac79-4416-90f9-36c6db8a73cc tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Getting quotas for user 6883da006d3f4aec8805c74cf5ffae86 and project b1222038740244f69a977fe658d9bfe0. Resources: {'key_pairs'} {{(pid=120472) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 13:36:55.883144 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-f88fe052-ac79-4416-90f9-36c6db8a73cc tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.107850 May 19 13:36:55.893529 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 318/650] 10.222.0.24 () {60 vars in 1158 bytes} [Thu May 19 13:36:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 13:36:55.899008 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-7cbf8374-8384-45d1-8f4a-7e72b337ae2c tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:36:55.899970 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-7cbf8374-8384-45d1-8f4a-7e72b337ae2c tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 8ea882c7-9191-4712-91eb-a810e49b9e52] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:36:55.907917 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-7cbf8374-8384-45d1-8f4a-7e72b337ae2c tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:55.908595 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-7cbf8374-8384-45d1-8f4a-7e72b337ae2c tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:55.909654 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-7cbf8374-8384-45d1-8f4a-7e72b337ae2c tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:55.910329 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-7cbf8374-8384-45d1-8f4a-7e72b337ae2c tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:55.980889 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-939f8346-69df-4775-b51b-786ac4db5eb4 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0a4b41707d444581ee0aa2296ac0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ad7b921dbc4a8d9e9be0d50385deee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:36:55.994278 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-939f8346-69df-4775-b51b-786ac4db5eb4 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] 10.222.0.24 "GET /compute/v2.1/servers/9ffb3760-1c38-48de-abb9-ac0e14389d8f" status: 200 len: 1266 microversion: 2.1 time: 0.250840 May 19 13:36:55.996628 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 333/651] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:36:55 2022] GET /compute/v2.1/servers/9ffb3760-1c38-48de-abb9-ac0e14389d8f => generated 1266 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:36:56.107449 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-7cbf8374-8384-45d1-8f4a-7e72b337ae2c tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:36:56.116663 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-7cbf8374-8384-45d1-8f4a-7e72b337ae2c tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:36:56.118784 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-7cbf8374-8384-45d1-8f4a-7e72b337ae2c tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:36:56.120199 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-7cbf8374-8384-45d1-8f4a-7e72b337ae2c tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52" status: 200 len: 1740 microversion: 2.20 time: 0.225351 May 19 13:36:56.120633 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 319/652] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:36:55 2022] GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52 => generated 1740 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:36:57.013510 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-1ca2a972-e3ba-4079-89e5-f7640588c3b6 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:36:57.014891 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-1ca2a972-e3ba-4079-89e5-f7640588c3b6 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] [instance: 9ffb3760-1c38-48de-abb9-ac0e14389d8f] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:36:57.030984 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-1ca2a972-e3ba-4079-89e5-f7640588c3b6 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:57.031804 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-1ca2a972-e3ba-4079-89e5-f7640588c3b6 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:57.033711 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-1ca2a972-e3ba-4079-89e5-f7640588c3b6 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:57.034474 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-1ca2a972-e3ba-4079-89e5-f7640588c3b6 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:57.080334 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [req-4025fa98-d726-45f3-85e9-dc34cf1259b4 req-178a61f6-98df-4173-a78b-6e8bcc217f50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ea882c7-9191-4712-91eb-a810e49b9e52", "name": "network-vif-plugged", "status": "completed", "tag": "23d6a89e-f532-421c-8c67-0672e13b68a3"}]} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:36:57.092529 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-4025fa98-d726-45f3-85e9-dc34cf1259b4 req-178a61f6-98df-4173-a78b-6e8bcc217f50 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:57.093261 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-4025fa98-d726-45f3-85e9-dc34cf1259b4 req-178a61f6-98df-4173-a78b-6e8bcc217f50 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:57.128488 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.compute.server_external_events [req-4025fa98-d726-45f3-85e9-dc34cf1259b4 req-178a61f6-98df-4173-a78b-6e8bcc217f50 service nova] Creating event network-vif-plugged:23d6a89e-f532-421c-8c67-0672e13b68a3 for instance 8ea882c7-9191-4712-91eb-a810e49b9e52 on hv-cinder-84112 May 19 13:36:57.141467 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [req-4025fa98-d726-45f3-85e9-dc34cf1259b4 req-178a61f6-98df-4173-a78b-6e8bcc217f50 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.169449 May 19 13:36:57.142950 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 334/653] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:36:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:36:57.151060 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-7e6d61d7-5ac9-4b4a-ab96-772e29200fa9 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:36:57.154798 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-7e6d61d7-5ac9-4b4a-ab96-772e29200fa9 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 8ea882c7-9191-4712-91eb-a810e49b9e52] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:36:57.170827 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-7e6d61d7-5ac9-4b4a-ab96-772e29200fa9 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:57.182410 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-7e6d61d7-5ac9-4b4a-ab96-772e29200fa9 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:57.183802 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-7e6d61d7-5ac9-4b4a-ab96-772e29200fa9 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:57.184439 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-7e6d61d7-5ac9-4b4a-ab96-772e29200fa9 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:57.297705 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-1ca2a972-e3ba-4079-89e5-f7640588c3b6 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0a4b41707d444581ee0aa2296ac0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ad7b921dbc4a8d9e9be0d50385deee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:36:57.308515 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-1ca2a972-e3ba-4079-89e5-f7640588c3b6 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] 10.222.0.24 "GET /compute/v2.1/servers/9ffb3760-1c38-48de-abb9-ac0e14389d8f" status: 200 len: 1266 microversion: 2.1 time: 0.299429 May 19 13:36:57.309217 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 320/654] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:36:57 2022] GET /compute/v2.1/servers/9ffb3760-1c38-48de-abb9-ac0e14389d8f => generated 1266 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:36:57.505639 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-7e6d61d7-5ac9-4b4a-ab96-772e29200fa9 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:36:57.515426 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-7e6d61d7-5ac9-4b4a-ab96-772e29200fa9 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:36:57.517149 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-7e6d61d7-5ac9-4b4a-ab96-772e29200fa9 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:36:57.518357 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-7e6d61d7-5ac9-4b4a-ab96-772e29200fa9 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52" status: 200 len: 1740 microversion: 2.20 time: 0.374123 May 19 13:36:57.519121 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 335/655] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:36:57 2022] GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52 => generated 1740 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:36:57.726179 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-6cc01648-725c-41ca-acd7-cb9048c75eb3 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-437616715", "imageRef": "9beb860d-9c3f-4244-80aa-71a9c337a429", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c86071f6-6021-438e-94aa-a1421372fa5c"}], "security_groups": [{"name": "tempest-securitygroup--1915981613"}], "key_name": "tempest-keypair-1063460404", "user_data": "}} {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:36:57.860136 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.network.neutron [None req-6cc01648-725c-41ca-acd7-cb9048c75eb3 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] validate_networks() for [('c86071f6-6021-438e-94aa-a1421372fa5c', None, None, None, None, None)] {{(pid=120472) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 13:36:58.327240 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-ee4a169c-7b3d-4d1a-bf02-c7e5f13e14e8 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:36:58.327851 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-ee4a169c-7b3d-4d1a-bf02-c7e5f13e14e8 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] [instance: 9ffb3760-1c38-48de-abb9-ac0e14389d8f] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:36:58.347651 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-ee4a169c-7b3d-4d1a-bf02-c7e5f13e14e8 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:58.348590 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-ee4a169c-7b3d-4d1a-bf02-c7e5f13e14e8 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:58.349669 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-ee4a169c-7b3d-4d1a-bf02-c7e5f13e14e8 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:58.350285 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-ee4a169c-7b3d-4d1a-bf02-c7e5f13e14e8 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:58.562089 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.virt.hardware [None req-6cc01648-725c-41ca-acd7-cb9048c75eb3 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Flavor limits 0:0:0 {{(pid=120472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 13:36:58.563182 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.virt.hardware [None req-6cc01648-725c-41ca-acd7-cb9048c75eb3 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Image limits 0:0:0 {{(pid=120472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 13:36:58.564254 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.virt.hardware [None req-6cc01648-725c-41ca-acd7-cb9048c75eb3 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Flavor pref 0:0:0 {{(pid=120472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 13:36:58.564921 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.virt.hardware [None req-6cc01648-725c-41ca-acd7-cb9048c75eb3 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Image pref 0:0:0 {{(pid=120472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 13:36:58.565553 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.virt.hardware [None req-6cc01648-725c-41ca-acd7-cb9048c75eb3 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 13:36:58.578163 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-6cc01648-725c-41ca-acd7-cb9048c75eb3 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:58.579061 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-6cc01648-725c-41ca-acd7-cb9048c75eb3 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:58.580230 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-6cc01648-725c-41ca-acd7-cb9048c75eb3 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:58.580856 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-6cc01648-725c-41ca-acd7-cb9048c75eb3 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:58.594022 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-ee4a169c-7b3d-4d1a-bf02-c7e5f13e14e8 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0a4b41707d444581ee0aa2296ac0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ad7b921dbc4a8d9e9be0d50385deee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:36:58.608786 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.quota [None req-6cc01648-725c-41ca-acd7-cb9048c75eb3 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Getting quotas for project b1222038740244f69a977fe658d9bfe0. Resources: {'instances', 'cores', 'ram'} {{(pid=120472) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 13:36:58.613938 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.quota [None req-6cc01648-725c-41ca-acd7-cb9048c75eb3 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Getting quotas for user 6883da006d3f4aec8805c74cf5ffae86 and project b1222038740244f69a977fe658d9bfe0. Resources: {'instances', 'cores', 'ram'} {{(pid=120472) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 13:36:58.616107 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-ee4a169c-7b3d-4d1a-bf02-c7e5f13e14e8 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] 10.222.0.24 "GET /compute/v2.1/servers/9ffb3760-1c38-48de-abb9-ac0e14389d8f" status: 200 len: 1266 microversion: 2.1 time: 0.293572 May 19 13:36:58.616783 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 336/656] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:36:58 2022] GET /compute/v2.1/servers/9ffb3760-1c38-48de-abb9-ac0e14389d8f => generated 1266 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:36:58.621642 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-0a353571-1334-4418-9001-25c5c829bf05 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:36:58.626300 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-0a353571-1334-4418-9001-25c5c829bf05 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 8ea882c7-9191-4712-91eb-a810e49b9e52] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:36:58.636894 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-0a353571-1334-4418-9001-25c5c829bf05 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:58.637877 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-6cc01648-725c-41ca-acd7-cb9048c75eb3 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Going to run 1 instances... {{(pid=120472) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 13:36:58.640365 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-6cc01648-725c-41ca-acd7-cb9048c75eb3 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [instance: 5b705092-099b-444c-81cf-ecfacd701ac1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9beb860d-9c3f-4244-80aa-71a9c337a429',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120472) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 13:36:58.643172 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-0a353571-1334-4418-9001-25c5c829bf05 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:58.643877 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-0a353571-1334-4418-9001-25c5c829bf05 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:58.644319 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-0a353571-1334-4418-9001-25c5c829bf05 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:58.704338 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-6cc01648-725c-41ca-acd7-cb9048c75eb3 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.982314 May 19 13:36:58.710962 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 321/657] 10.222.0.24 () {60 vars in 1146 bytes} [Thu May 19 13:36:57 2022] POST /compute/v2.1/servers => generated 402 bytes in 989 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 13:36:58.717949 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-834bda69-9af5-495e-a39b-f1511ab58e59 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:36:58.718832 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-834bda69-9af5-495e-a39b-f1511ab58e59 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [instance: 5b705092-099b-444c-81cf-ecfacd701ac1] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:36:58.843647 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-834bda69-9af5-495e-a39b-f1511ab58e59 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883da006d3f4aec8805c74cf5ffae86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1222038740244f69a977fe658d9bfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:36:58.847129 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-0a353571-1334-4418-9001-25c5c829bf05 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:36:58.852868 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-834bda69-9af5-495e-a39b-f1511ab58e59 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "GET /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1" status: 200 len: 1237 microversion: 2.1 time: 0.140368 May 19 13:36:58.853664 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 322/658] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:36:58 2022] GET /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1 => generated 1237 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:36:58.861396 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-0a353571-1334-4418-9001-25c5c829bf05 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:36:58.863457 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-0a353571-1334-4418-9001-25c5c829bf05 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:36:58.864661 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-0a353571-1334-4418-9001-25c5c829bf05 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52" status: 200 len: 1740 microversion: 2.20 time: 0.246690 May 19 13:36:58.865207 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 337/659] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:36:58 2022] GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52 => generated 1740 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:36:59.633192 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-d0d8f39e-fe92-4db9-be1f-ce0f0822e51b tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:36:59.633854 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-d0d8f39e-fe92-4db9-be1f-ce0f0822e51b tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] [instance: 9ffb3760-1c38-48de-abb9-ac0e14389d8f] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:36:59.645781 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-d0d8f39e-fe92-4db9-be1f-ce0f0822e51b tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:59.646660 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-d0d8f39e-fe92-4db9-be1f-ce0f0822e51b tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:59.647680 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-d0d8f39e-fe92-4db9-be1f-ce0f0822e51b tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:59.648328 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-d0d8f39e-fe92-4db9-be1f-ce0f0822e51b tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:59.844974 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-d0d8f39e-fe92-4db9-be1f-ce0f0822e51b tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0a4b41707d444581ee0aa2296ac0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ad7b921dbc4a8d9e9be0d50385deee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:36:59.853474 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-d0d8f39e-fe92-4db9-be1f-ce0f0822e51b tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] 10.222.0.24 "GET /compute/v2.1/servers/9ffb3760-1c38-48de-abb9-ac0e14389d8f" status: 200 len: 1266 microversion: 2.1 time: 0.224033 May 19 13:36:59.855428 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 323/660] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:36:59 2022] GET /compute/v2.1/servers/9ffb3760-1c38-48de-abb9-ac0e14389d8f => generated 1266 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:36:59.871719 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-90a22713-48a6-4a00-8323-47c47fa12d42 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:36:59.872811 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-90a22713-48a6-4a00-8323-47c47fa12d42 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [instance: 5b705092-099b-444c-81cf-ecfacd701ac1] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:36:59.875044 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_cell0:SELECT=2 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:36:59.877607 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_cell0:SELECT=6 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:36:59.884818 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-4db388da-023c-48ca-adbc-4c34eb87fa80 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:36:59.887379 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-4db388da-023c-48ca-adbc-4c34eb87fa80 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 8ea882c7-9191-4712-91eb-a810e49b9e52] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:36:59.900021 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-4db388da-023c-48ca-adbc-4c34eb87fa80 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:59.900754 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-4db388da-023c-48ca-adbc-4c34eb87fa80 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:59.901788 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-4db388da-023c-48ca-adbc-4c34eb87fa80 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:59.902835 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-90a22713-48a6-4a00-8323-47c47fa12d42 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:59.903173 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-4db388da-023c-48ca-adbc-4c34eb87fa80 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:59.903630 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-90a22713-48a6-4a00-8323-47c47fa12d42 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:36:59.904559 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-90a22713-48a6-4a00-8323-47c47fa12d42 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:36:59.905178 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-90a22713-48a6-4a00-8323-47c47fa12d42 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:00.021642 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-90a22713-48a6-4a00-8323-47c47fa12d42 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883da006d3f4aec8805c74cf5ffae86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1222038740244f69a977fe658d9bfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:00.033602 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-90a22713-48a6-4a00-8323-47c47fa12d42 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "GET /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1" status: 200 len: 1289 microversion: 2.1 time: 0.163138 May 19 13:37:00.045892 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 338/661] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:36:59 2022] GET /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1 => generated 1289 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:37:00.145664 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-4db388da-023c-48ca-adbc-4c34eb87fa80 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:00.155704 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-4db388da-023c-48ca-adbc-4c34eb87fa80 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:00.157278 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-4db388da-023c-48ca-adbc-4c34eb87fa80 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:00.159208 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-4db388da-023c-48ca-adbc-4c34eb87fa80 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52" status: 200 len: 1740 microversion: 2.20 time: 0.279842 May 19 13:37:00.160129 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 324/662] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:36:59 2022] GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52 => generated 1740 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 13:37:00.873246 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-3a1e88b5-ae75-4732-a4f3-57f114d65773 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:37:00.874514 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-3a1e88b5-ae75-4732-a4f3-57f114d65773 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] [instance: 9ffb3760-1c38-48de-abb9-ac0e14389d8f] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:37:00.884566 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-3a1e88b5-ae75-4732-a4f3-57f114d65773 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:00.885019 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-3a1e88b5-ae75-4732-a4f3-57f114d65773 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:00.885825 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-3a1e88b5-ae75-4732-a4f3-57f114d65773 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:00.892329 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-3a1e88b5-ae75-4732-a4f3-57f114d65773 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:01.051253 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-19f0c8fe-87e5-477e-8ef6-eaa2d17236a1 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:37:01.052494 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-19f0c8fe-87e5-477e-8ef6-eaa2d17236a1 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [instance: 5b705092-099b-444c-81cf-ecfacd701ac1] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:37:01.076566 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-19f0c8fe-87e5-477e-8ef6-eaa2d17236a1 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:01.076695 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-19f0c8fe-87e5-477e-8ef6-eaa2d17236a1 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:01.077506 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-19f0c8fe-87e5-477e-8ef6-eaa2d17236a1 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:01.078114 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-19f0c8fe-87e5-477e-8ef6-eaa2d17236a1 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:01.122217 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-3a1e88b5-ae75-4732-a4f3-57f114d65773 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0a4b41707d444581ee0aa2296ac0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ad7b921dbc4a8d9e9be0d50385deee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:01.135266 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-3a1e88b5-ae75-4732-a4f3-57f114d65773 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] 10.222.0.24 "GET /compute/v2.1/servers/9ffb3760-1c38-48de-abb9-ac0e14389d8f" status: 200 len: 1266 microversion: 2.1 time: 0.266950 May 19 13:37:01.142869 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 339/663] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:37:00 2022] GET /compute/v2.1/servers/9ffb3760-1c38-48de-abb9-ac0e14389d8f => generated 1266 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:37:01.185036 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-40ae88ef-843a-4977-99a1-bf755f916286 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:37:01.185877 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-40ae88ef-843a-4977-99a1-bf755f916286 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 8ea882c7-9191-4712-91eb-a810e49b9e52] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:37:01.206973 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-40ae88ef-843a-4977-99a1-bf755f916286 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:01.207680 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-40ae88ef-843a-4977-99a1-bf755f916286 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:01.208633 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-40ae88ef-843a-4977-99a1-bf755f916286 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:01.209274 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-40ae88ef-843a-4977-99a1-bf755f916286 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:01.232624 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-19f0c8fe-87e5-477e-8ef6-eaa2d17236a1 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883da006d3f4aec8805c74cf5ffae86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1222038740244f69a977fe658d9bfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:01.241843 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-19f0c8fe-87e5-477e-8ef6-eaa2d17236a1 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "GET /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1" status: 200 len: 1295 microversion: 2.1 time: 0.194201 May 19 13:37:01.252495 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 325/664] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:37:01 2022] GET /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1 => generated 1295 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:37:01.378819 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-40ae88ef-843a-4977-99a1-bf755f916286 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:01.389892 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-40ae88ef-843a-4977-99a1-bf755f916286 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:01.392767 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-40ae88ef-843a-4977-99a1-bf755f916286 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:01.394311 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-40ae88ef-843a-4977-99a1-bf755f916286 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52" status: 200 len: 1740 microversion: 2.20 time: 0.214601 May 19 13:37:01.405855 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 340/665] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:37:01 2022] GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52 => generated 1740 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:37:02.151887 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-5630d1d8-6017-4151-821d-3d8a5e972c1d tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:37:02.152662 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-5630d1d8-6017-4151-821d-3d8a5e972c1d tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] [instance: 9ffb3760-1c38-48de-abb9-ac0e14389d8f] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:37:02.158733 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-5630d1d8-6017-4151-821d-3d8a5e972c1d tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:02.159165 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-5630d1d8-6017-4151-821d-3d8a5e972c1d tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:02.159915 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-5630d1d8-6017-4151-821d-3d8a5e972c1d tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:02.160330 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-5630d1d8-6017-4151-821d-3d8a5e972c1d tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:02.269803 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-98cfc9f7-1a46-490c-aaca-2d38303ca962 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:37:02.271982 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-98cfc9f7-1a46-490c-aaca-2d38303ca962 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [instance: 5b705092-099b-444c-81cf-ecfacd701ac1] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:37:02.285871 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-98cfc9f7-1a46-490c-aaca-2d38303ca962 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:02.286748 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-98cfc9f7-1a46-490c-aaca-2d38303ca962 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:02.288427 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-98cfc9f7-1a46-490c-aaca-2d38303ca962 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:02.289256 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-98cfc9f7-1a46-490c-aaca-2d38303ca962 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:02.413501 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-5630d1d8-6017-4151-821d-3d8a5e972c1d tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0a4b41707d444581ee0aa2296ac0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ad7b921dbc4a8d9e9be0d50385deee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:02.428194 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-5630d1d8-6017-4151-821d-3d8a5e972c1d tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] 10.222.0.24 "GET /compute/v2.1/servers/9ffb3760-1c38-48de-abb9-ac0e14389d8f" status: 200 len: 1266 microversion: 2.1 time: 0.279918 May 19 13:37:02.428778 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 326/666] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:37:02 2022] GET /compute/v2.1/servers/9ffb3760-1c38-48de-abb9-ac0e14389d8f => generated 1266 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:37:02.433427 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-4e0b737a-aa03-4c61-b35c-0624c6b03362 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:37:02.434023 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-4e0b737a-aa03-4c61-b35c-0624c6b03362 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 8ea882c7-9191-4712-91eb-a810e49b9e52] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:37:02.451728 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-4e0b737a-aa03-4c61-b35c-0624c6b03362 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:02.452171 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-4e0b737a-aa03-4c61-b35c-0624c6b03362 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:02.452949 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-4e0b737a-aa03-4c61-b35c-0624c6b03362 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:02.453372 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-4e0b737a-aa03-4c61-b35c-0624c6b03362 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:02.475953 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-98cfc9f7-1a46-490c-aaca-2d38303ca962 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883da006d3f4aec8805c74cf5ffae86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1222038740244f69a977fe658d9bfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:02.477329 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_cell1:SELECT=100 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:37:02.485313 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-98cfc9f7-1a46-490c-aaca-2d38303ca962 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "GET /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1" status: 200 len: 1363 microversion: 2.1 time: 0.229328 May 19 13:37:02.498558 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 341/667] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:37:02 2022] GET /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1 => generated 1363 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:37:02.741800 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-4e0b737a-aa03-4c61-b35c-0624c6b03362 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:02.755617 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-4e0b737a-aa03-4c61-b35c-0624c6b03362 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:02.757125 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-4e0b737a-aa03-4c61-b35c-0624c6b03362 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:02.758523 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-4e0b737a-aa03-4c61-b35c-0624c6b03362 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52" status: 200 len: 1740 microversion: 2.20 time: 0.328788 May 19 13:37:02.762104 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 327/668] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:37:02 2022] GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52 => generated 1740 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:37:02.932978 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [req-d69155e6-0fc9-4a50-805b-0c5e8b1efdf2 req-08c568ac-e875-4e5a-84ef-28bb63137c25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b705092-099b-444c-81cf-ecfacd701ac1", "tag": "f893dedd-28aa-4e31-8cfb-add216f8a285"}]} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:37:02.982383 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-d69155e6-0fc9-4a50-805b-0c5e8b1efdf2 req-08c568ac-e875-4e5a-84ef-28bb63137c25 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:02.982986 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-d69155e6-0fc9-4a50-805b-0c5e8b1efdf2 req-08c568ac-e875-4e5a-84ef-28bb63137c25 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:02.993322 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [req-0504b0c6-412c-4100-8ce3-7f3291327a0e req-380478a2-0ea3-4c6e-8051-789adef976b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ffb3760-1c38-48de-abb9-ac0e14389d8f", "name": "network-vif-plugged", "status": "completed", "tag": "dc294f75-6a16-4072-8363-f879c3f39838"}]} {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:37:03.014242 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [req-0504b0c6-412c-4100-8ce3-7f3291327a0e req-380478a2-0ea3-4c6e-8051-789adef976b6 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:03.014553 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [req-0504b0c6-412c-4100-8ce3-7f3291327a0e req-380478a2-0ea3-4c6e-8051-789adef976b6 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:03.017174 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.compute.server_external_events [req-d69155e6-0fc9-4a50-805b-0c5e8b1efdf2 req-08c568ac-e875-4e5a-84ef-28bb63137c25 service nova] Creating event network-changed:f893dedd-28aa-4e31-8cfb-add216f8a285 for instance 5b705092-099b-444c-81cf-ecfacd701ac1 on hv-cinder-84112 May 19 13:37:03.025378 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [req-d69155e6-0fc9-4a50-805b-0c5e8b1efdf2 req-08c568ac-e875-4e5a-84ef-28bb63137c25 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099139 May 19 13:37:03.026947 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 342/669] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:37:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:37:03.037547 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.compute.server_external_events [req-0504b0c6-412c-4100-8ce3-7f3291327a0e req-380478a2-0ea3-4c6e-8051-789adef976b6 service nova] Creating event network-vif-plugged:dc294f75-6a16-4072-8363-f879c3f39838 for instance 9ffb3760-1c38-48de-abb9-ac0e14389d8f on hv-cinder-84112 May 19 13:37:03.047612 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [req-0504b0c6-412c-4100-8ce3-7f3291327a0e req-380478a2-0ea3-4c6e-8051-789adef976b6 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057296 May 19 13:37:03.049089 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 328/670] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:37:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 13:37:03.447825 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-6ff8a47a-0fa7-4c4d-81ed-bf8036947a9e tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:37:03.451496 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-6ff8a47a-0fa7-4c4d-81ed-bf8036947a9e tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] [instance: 9ffb3760-1c38-48de-abb9-ac0e14389d8f] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:37:03.462581 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-6ff8a47a-0fa7-4c4d-81ed-bf8036947a9e tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:03.463287 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-6ff8a47a-0fa7-4c4d-81ed-bf8036947a9e tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:03.464208 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-6ff8a47a-0fa7-4c4d-81ed-bf8036947a9e tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:03.465141 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-6ff8a47a-0fa7-4c4d-81ed-bf8036947a9e tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:03.493266 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_cell1:SELECT=100 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:37:03.503645 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-6111bb33-7ae7-4811-ae68-3c87acc3f3b8 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:37:03.505172 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-6111bb33-7ae7-4811-ae68-3c87acc3f3b8 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [instance: 5b705092-099b-444c-81cf-ecfacd701ac1] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:37:03.518782 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-6111bb33-7ae7-4811-ae68-3c87acc3f3b8 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:03.519226 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-6111bb33-7ae7-4811-ae68-3c87acc3f3b8 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:03.520032 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-6111bb33-7ae7-4811-ae68-3c87acc3f3b8 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:03.520466 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-6111bb33-7ae7-4811-ae68-3c87acc3f3b8 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:03.689577 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-6ff8a47a-0fa7-4c4d-81ed-bf8036947a9e tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0a4b41707d444581ee0aa2296ac0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ad7b921dbc4a8d9e9be0d50385deee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:03.699438 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-6ff8a47a-0fa7-4c4d-81ed-bf8036947a9e tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] 10.222.0.24 "GET /compute/v2.1/servers/9ffb3760-1c38-48de-abb9-ac0e14389d8f" status: 200 len: 1266 microversion: 2.1 time: 0.258244 May 19 13:37:03.700695 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 343/671] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:37:03 2022] GET /compute/v2.1/servers/9ffb3760-1c38-48de-abb9-ac0e14389d8f => generated 1266 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:37:03.746923 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-6111bb33-7ae7-4811-ae68-3c87acc3f3b8 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883da006d3f4aec8805c74cf5ffae86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1222038740244f69a977fe658d9bfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:03.755243 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-6111bb33-7ae7-4811-ae68-3c87acc3f3b8 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "GET /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1" status: 200 len: 1363 microversion: 2.1 time: 0.256212 May 19 13:37:03.756252 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 329/672] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:37:03 2022] GET /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1 => generated 1363 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:37:03.782779 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-eda0a035-072d-412b-b094-43bef0d5eb29 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:37:03.783383 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-eda0a035-072d-412b-b094-43bef0d5eb29 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 8ea882c7-9191-4712-91eb-a810e49b9e52] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:37:03.789669 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-eda0a035-072d-412b-b094-43bef0d5eb29 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:03.790121 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-eda0a035-072d-412b-b094-43bef0d5eb29 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:03.791079 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-eda0a035-072d-412b-b094-43bef0d5eb29 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:03.792285 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-eda0a035-072d-412b-b094-43bef0d5eb29 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:03.959441 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-eda0a035-072d-412b-b094-43bef0d5eb29 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:03.968142 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-eda0a035-072d-412b-b094-43bef0d5eb29 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:03.971164 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-eda0a035-072d-412b-b094-43bef0d5eb29 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:03.972963 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-eda0a035-072d-412b-b094-43bef0d5eb29 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52" status: 200 len: 1740 microversion: 2.20 time: 0.194296 May 19 13:37:03.973688 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 344/673] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:37:03 2022] GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52 => generated 1740 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:37:04.716447 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-0f74e2f3-d074-4605-aa6c-23eb6cb26fde tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:37:04.720605 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-0f74e2f3-d074-4605-aa6c-23eb6cb26fde tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] [instance: 9ffb3760-1c38-48de-abb9-ac0e14389d8f] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:37:04.727872 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-0f74e2f3-d074-4605-aa6c-23eb6cb26fde tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:04.728565 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-0f74e2f3-d074-4605-aa6c-23eb6cb26fde tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:04.729522 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-0f74e2f3-d074-4605-aa6c-23eb6cb26fde tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:04.730176 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-0f74e2f3-d074-4605-aa6c-23eb6cb26fde tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:04.774441 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-e7c3f37b-9a01-4716-aa7e-fa8000ce310a tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:37:04.775650 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-e7c3f37b-9a01-4716-aa7e-fa8000ce310a tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [instance: 5b705092-099b-444c-81cf-ecfacd701ac1] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:37:04.786293 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-e7c3f37b-9a01-4716-aa7e-fa8000ce310a tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:04.787387 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-e7c3f37b-9a01-4716-aa7e-fa8000ce310a tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:04.788510 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-e7c3f37b-9a01-4716-aa7e-fa8000ce310a tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:04.790598 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-e7c3f37b-9a01-4716-aa7e-fa8000ce310a tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:04.954151 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-0f74e2f3-d074-4605-aa6c-23eb6cb26fde tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0a4b41707d444581ee0aa2296ac0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ad7b921dbc4a8d9e9be0d50385deee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:04.972710 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-0f74e2f3-d074-4605-aa6c-23eb6cb26fde tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] 10.222.0.24 "GET /compute/v2.1/servers/9ffb3760-1c38-48de-abb9-ac0e14389d8f" status: 200 len: 1266 microversion: 2.1 time: 0.257188 May 19 13:37:04.973742 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 330/674] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:37:04 2022] GET /compute/v2.1/servers/9ffb3760-1c38-48de-abb9-ac0e14389d8f => generated 1266 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:37:04.995612 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-c31409ba-73a7-4717-a2fb-db3a60a48fa5 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:37:04.996381 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-c31409ba-73a7-4717-a2fb-db3a60a48fa5 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 8ea882c7-9191-4712-91eb-a810e49b9e52] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:37:05.005308 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-e7c3f37b-9a01-4716-aa7e-fa8000ce310a tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883da006d3f4aec8805c74cf5ffae86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1222038740244f69a977fe658d9bfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:05.012414 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-c31409ba-73a7-4717-a2fb-db3a60a48fa5 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:05.012870 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-c31409ba-73a7-4717-a2fb-db3a60a48fa5 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:05.013679 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-c31409ba-73a7-4717-a2fb-db3a60a48fa5 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:05.014112 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-c31409ba-73a7-4717-a2fb-db3a60a48fa5 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:05.017905 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-e7c3f37b-9a01-4716-aa7e-fa8000ce310a tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "GET /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1" status: 200 len: 1363 microversion: 2.1 time: 0.247669 May 19 13:37:05.019095 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 345/675] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:37:04 2022] GET /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1 => generated 1363 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:37:05.192639 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-c31409ba-73a7-4717-a2fb-db3a60a48fa5 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:05.202278 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-c31409ba-73a7-4717-a2fb-db3a60a48fa5 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:05.203889 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-c31409ba-73a7-4717-a2fb-db3a60a48fa5 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:05.205288 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-c31409ba-73a7-4717-a2fb-db3a60a48fa5 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52" status: 200 len: 1740 microversion: 2.20 time: 0.217827 May 19 13:37:05.205872 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 331/676] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:37:04 2022] GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52 => generated 1740 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 13:37:05.991179 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-87339ae6-2bf9-401f-ba8d-319f8e07560e tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:37:05.992417 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-87339ae6-2bf9-401f-ba8d-319f8e07560e tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] [instance: 9ffb3760-1c38-48de-abb9-ac0e14389d8f] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:37:06.000037 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-87339ae6-2bf9-401f-ba8d-319f8e07560e tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:06.000802 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-87339ae6-2bf9-401f-ba8d-319f8e07560e tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:06.001667 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-87339ae6-2bf9-401f-ba8d-319f8e07560e tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:06.002192 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-87339ae6-2bf9-401f-ba8d-319f8e07560e tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:06.035460 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-bef60da0-af62-4cc4-8f4c-441d0f89c371 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:37:06.036058 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-bef60da0-af62-4cc4-8f4c-441d0f89c371 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [instance: 5b705092-099b-444c-81cf-ecfacd701ac1] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:37:06.063815 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-bef60da0-af62-4cc4-8f4c-441d0f89c371 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:06.064274 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-bef60da0-af62-4cc4-8f4c-441d0f89c371 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:06.065085 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-bef60da0-af62-4cc4-8f4c-441d0f89c371 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:06.065554 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-bef60da0-af62-4cc4-8f4c-441d0f89c371 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:06.188893 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-87339ae6-2bf9-401f-ba8d-319f8e07560e tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0a4b41707d444581ee0aa2296ac0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ad7b921dbc4a8d9e9be0d50385deee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:06.198256 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-87339ae6-2bf9-401f-ba8d-319f8e07560e tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] 10.222.0.24 "GET /compute/v2.1/servers/9ffb3760-1c38-48de-abb9-ac0e14389d8f" status: 200 len: 1452 microversion: 2.1 time: 0.210885 May 19 13:37:06.198983 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 346/677] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:37:05 2022] GET /compute/v2.1/servers/9ffb3760-1c38-48de-abb9-ac0e14389d8f => generated 1452 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:37:06.217580 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-af3a920c-0862-45f4-adcf-3a51e1f3d01e tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:37:06.218777 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-af3a920c-0862-45f4-adcf-3a51e1f3d01e tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] [instance: 9ffb3760-1c38-48de-abb9-ac0e14389d8f] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:37:06.227532 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-af3a920c-0862-45f4-adcf-3a51e1f3d01e tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:06.228871 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-af3a920c-0862-45f4-adcf-3a51e1f3d01e tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:06.229886 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-af3a920c-0862-45f4-adcf-3a51e1f3d01e tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:06.230509 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-af3a920c-0862-45f4-adcf-3a51e1f3d01e tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:06.236697 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-bef60da0-af62-4cc4-8f4c-441d0f89c371 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883da006d3f4aec8805c74cf5ffae86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1222038740244f69a977fe658d9bfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:06.248245 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-bef60da0-af62-4cc4-8f4c-441d0f89c371 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "GET /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1" status: 200 len: 1363 microversion: 2.1 time: 0.216658 May 19 13:37:06.262090 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 332/678] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:37:06 2022] GET /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1 => generated 1363 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:37:06.262090 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-ded21ba6-99e2-4edb-a12a-f685b0fd9741 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:37:06.262090 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-ded21ba6-99e2-4edb-a12a-f685b0fd9741 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 8ea882c7-9191-4712-91eb-a810e49b9e52] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:37:06.263289 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-ded21ba6-99e2-4edb-a12a-f685b0fd9741 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:06.263747 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-ded21ba6-99e2-4edb-a12a-f685b0fd9741 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:06.264957 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-ded21ba6-99e2-4edb-a12a-f685b0fd9741 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:06.264957 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-ded21ba6-99e2-4edb-a12a-f685b0fd9741 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:06.412339 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-af3a920c-0862-45f4-adcf-3a51e1f3d01e tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0a4b41707d444581ee0aa2296ac0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ad7b921dbc4a8d9e9be0d50385deee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:06.421440 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-af3a920c-0862-45f4-adcf-3a51e1f3d01e tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] 10.222.0.24 "GET /compute/v2.1/servers/9ffb3760-1c38-48de-abb9-ac0e14389d8f" status: 200 len: 1452 microversion: 2.1 time: 0.207557 May 19 13:37:06.422276 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 347/679] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:37:06 2022] GET /compute/v2.1/servers/9ffb3760-1c38-48de-abb9-ac0e14389d8f => generated 1452 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:37:06.429099 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-ded21ba6-99e2-4edb-a12a-f685b0fd9741 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:06.441678 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-ded21ba6-99e2-4edb-a12a-f685b0fd9741 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:06.443387 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-ded21ba6-99e2-4edb-a12a-f685b0fd9741 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:06.444617 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-ded21ba6-99e2-4edb-a12a-f685b0fd9741 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52" status: 200 len: 1740 microversion: 2.20 time: 0.194178 May 19 13:37:06.445176 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 333/680] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:37:06 2022] GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52 => generated 1740 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:37:06.897098 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [req-8bc3617e-8773-45e0-997e-f09a46a39f3b req-cbb0d925-eebc-4623-b7a6-819c05c13178 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b705092-099b-444c-81cf-ecfacd701ac1", "name": "network-vif-plugged", "status": "completed", "tag": "f893dedd-28aa-4e31-8cfb-add216f8a285"}]} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:37:06.908322 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-8bc3617e-8773-45e0-997e-f09a46a39f3b req-cbb0d925-eebc-4623-b7a6-819c05c13178 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:06.909062 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-8bc3617e-8773-45e0-997e-f09a46a39f3b req-cbb0d925-eebc-4623-b7a6-819c05c13178 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:06.921485 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.compute.server_external_events [req-8bc3617e-8773-45e0-997e-f09a46a39f3b req-cbb0d925-eebc-4623-b7a6-819c05c13178 service nova] Creating event network-vif-plugged:f893dedd-28aa-4e31-8cfb-add216f8a285 for instance 5b705092-099b-444c-81cf-ecfacd701ac1 on hv-cinder-84112 May 19 13:37:06.927832 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [req-8bc3617e-8773-45e0-997e-f09a46a39f3b req-cbb0d925-eebc-4623-b7a6-819c05c13178 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035025 May 19 13:37:06.928739 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 348/681] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:37:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:37:07.266351 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-4b80965f-a947-48fe-8268-f2f213b85d6a tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:37:07.267246 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-4b80965f-a947-48fe-8268-f2f213b85d6a tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [instance: 5b705092-099b-444c-81cf-ecfacd701ac1] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:37:07.277554 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-4b80965f-a947-48fe-8268-f2f213b85d6a tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:07.278012 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-4b80965f-a947-48fe-8268-f2f213b85d6a tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:07.278792 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-4b80965f-a947-48fe-8268-f2f213b85d6a tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:07.279223 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-4b80965f-a947-48fe-8268-f2f213b85d6a tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:07.447664 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-4b80965f-a947-48fe-8268-f2f213b85d6a tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883da006d3f4aec8805c74cf5ffae86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1222038740244f69a977fe658d9bfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:07.463342 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-780fbbfc-87af-4285-9e8a-4adfd89e95da tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:37:07.464701 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-780fbbfc-87af-4285-9e8a-4adfd89e95da tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 8ea882c7-9191-4712-91eb-a810e49b9e52] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:37:07.468758 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-4b80965f-a947-48fe-8268-f2f213b85d6a tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "GET /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1" status: 200 len: 1363 microversion: 2.1 time: 0.194091 May 19 13:37:07.469395 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 334/682] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:37:07 2022] GET /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1 => generated 1363 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:37:07.473929 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-780fbbfc-87af-4285-9e8a-4adfd89e95da tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:07.474575 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-780fbbfc-87af-4285-9e8a-4adfd89e95da tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:07.475562 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-780fbbfc-87af-4285-9e8a-4adfd89e95da tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:07.476135 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-780fbbfc-87af-4285-9e8a-4adfd89e95da tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:07.694539 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-780fbbfc-87af-4285-9e8a-4adfd89e95da tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:07.703395 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-780fbbfc-87af-4285-9e8a-4adfd89e95da tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:07.705354 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-780fbbfc-87af-4285-9e8a-4adfd89e95da tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:07.706659 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-780fbbfc-87af-4285-9e8a-4adfd89e95da tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52" status: 200 len: 1740 microversion: 2.20 time: 0.247554 May 19 13:37:07.707201 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 349/683] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:37:07 2022] GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52 => generated 1740 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:37:08.486520 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-a8b6816b-e36f-4fbc-b1d4-60c87d2241c6 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:37:08.487248 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-a8b6816b-e36f-4fbc-b1d4-60c87d2241c6 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [instance: 5b705092-099b-444c-81cf-ecfacd701ac1] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:37:08.494009 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-a8b6816b-e36f-4fbc-b1d4-60c87d2241c6 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:08.494572 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-a8b6816b-e36f-4fbc-b1d4-60c87d2241c6 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:08.495390 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-a8b6816b-e36f-4fbc-b1d4-60c87d2241c6 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:08.495938 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-a8b6816b-e36f-4fbc-b1d4-60c87d2241c6 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:08.590519 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_cell0:SELECT=2 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:37:08.628150 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [req-6f2994ca-4b77-464a-ac8d-d39aae5519d0 req-c944051d-a2d8-446a-beb4-d2e9f04688f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ffb3760-1c38-48de-abb9-ac0e14389d8f", "tag": "dc294f75-6a16-4072-8363-f879c3f39838"}]} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:37:08.638343 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-6f2994ca-4b77-464a-ac8d-d39aae5519d0 req-c944051d-a2d8-446a-beb4-d2e9f04688f7 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:08.639060 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-6f2994ca-4b77-464a-ac8d-d39aae5519d0 req-c944051d-a2d8-446a-beb4-d2e9f04688f7 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:08.639177 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-a8b6816b-e36f-4fbc-b1d4-60c87d2241c6 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883da006d3f4aec8805c74cf5ffae86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1222038740244f69a977fe658d9bfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:08.648543 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-a8b6816b-e36f-4fbc-b1d4-60c87d2241c6 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "GET /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1" status: 200 len: 1363 microversion: 2.1 time: 0.166348 May 19 13:37:08.649635 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 335/684] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:37:08 2022] GET /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:37:08.655748 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.compute.server_external_events [req-6f2994ca-4b77-464a-ac8d-d39aae5519d0 req-c944051d-a2d8-446a-beb4-d2e9f04688f7 service nova] Creating event network-changed:dc294f75-6a16-4072-8363-f879c3f39838 for instance 9ffb3760-1c38-48de-abb9-ac0e14389d8f on hv-cinder-84112 May 19 13:37:08.661741 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [req-6f2994ca-4b77-464a-ac8d-d39aae5519d0 req-c944051d-a2d8-446a-beb4-d2e9f04688f7 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110204 May 19 13:37:08.662330 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 350/685] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:37:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:37:08.724899 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-3f51f46a-9213-40c5-84ad-59a8bd06ccb5 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:37:08.725607 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-3f51f46a-9213-40c5-84ad-59a8bd06ccb5 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 8ea882c7-9191-4712-91eb-a810e49b9e52] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:37:08.731707 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-3f51f46a-9213-40c5-84ad-59a8bd06ccb5 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:08.732214 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-3f51f46a-9213-40c5-84ad-59a8bd06ccb5 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:08.732908 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-3f51f46a-9213-40c5-84ad-59a8bd06ccb5 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:08.733324 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-3f51f46a-9213-40c5-84ad-59a8bd06ccb5 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:08.848569 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_cell0:SELECT=14 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:37:08.879584 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-3f51f46a-9213-40c5-84ad-59a8bd06ccb5 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:08.887674 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-3f51f46a-9213-40c5-84ad-59a8bd06ccb5 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:08.889176 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-3f51f46a-9213-40c5-84ad-59a8bd06ccb5 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:08.890317 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-3f51f46a-9213-40c5-84ad-59a8bd06ccb5 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52" status: 200 len: 1722 microversion: 2.20 time: 0.169885 May 19 13:37:08.890873 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 336/686] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:37:08 2022] GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:37:09.665901 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-4c13c46d-4cdf-4a5f-8371-bb04e83e75b6 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:37:09.667328 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-4c13c46d-4cdf-4a5f-8371-bb04e83e75b6 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [instance: 5b705092-099b-444c-81cf-ecfacd701ac1] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:37:09.675968 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-4c13c46d-4cdf-4a5f-8371-bb04e83e75b6 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:09.676753 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-4c13c46d-4cdf-4a5f-8371-bb04e83e75b6 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:09.677749 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-4c13c46d-4cdf-4a5f-8371-bb04e83e75b6 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:09.678552 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-4c13c46d-4cdf-4a5f-8371-bb04e83e75b6 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:09.910260 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-e364e3fb-5ad3-40df-8084-a10bceb1186f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:37:09.910983 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-e364e3fb-5ad3-40df-8084-a10bceb1186f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 8ea882c7-9191-4712-91eb-a810e49b9e52] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:37:09.918130 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-e364e3fb-5ad3-40df-8084-a10bceb1186f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:09.918574 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-e364e3fb-5ad3-40df-8084-a10bceb1186f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:09.919694 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-e364e3fb-5ad3-40df-8084-a10bceb1186f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:09.920105 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-e364e3fb-5ad3-40df-8084-a10bceb1186f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:10.046882 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-4c13c46d-4cdf-4a5f-8371-bb04e83e75b6 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883da006d3f4aec8805c74cf5ffae86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1222038740244f69a977fe658d9bfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:10.052948 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-e364e3fb-5ad3-40df-8084-a10bceb1186f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:10.055048 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-4c13c46d-4cdf-4a5f-8371-bb04e83e75b6 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "GET /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1" status: 200 len: 1548 microversion: 2.1 time: 0.393505 May 19 13:37:10.055601 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 351/687] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:37:09 2022] GET /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1 => generated 1548 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:37:10.061099 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-e364e3fb-5ad3-40df-8084-a10bceb1186f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:10.062623 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-e364e3fb-5ad3-40df-8084-a10bceb1186f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:10.064094 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-e364e3fb-5ad3-40df-8084-a10bceb1186f tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52" status: 200 len: 1722 microversion: 2.20 time: 0.157928 May 19 13:37:10.064703 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 337/688] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:37:09 2022] GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:37:10.071991 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-d402fa72-40ad-4888-92a3-95fe452cfa25 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:37:10.072477 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-d402fa72-40ad-4888-92a3-95fe452cfa25 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [instance: 5b705092-099b-444c-81cf-ecfacd701ac1] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:37:10.078570 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-d402fa72-40ad-4888-92a3-95fe452cfa25 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:10.079070 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-d402fa72-40ad-4888-92a3-95fe452cfa25 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:10.079829 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-d402fa72-40ad-4888-92a3-95fe452cfa25 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:10.080255 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-d402fa72-40ad-4888-92a3-95fe452cfa25 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:10.170883 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-d402fa72-40ad-4888-92a3-95fe452cfa25 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "GET /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102364 May 19 13:37:10.171815 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 352/689] 10.222.0.24 () {58 vars in 1274 bytes} [Thu May 19 13:37:10 2022] GET /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 13:37:10.836146 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [req-88d40fb2-e15d-483f-a8a8-3ff09b621925 req-2663f023-a041-42e2-8061-297630213bec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ea882c7-9191-4712-91eb-a810e49b9e52", "name": "network-vif-unplugged", "status": "completed", "tag": "23d6a89e-f532-421c-8c67-0672e13b68a3"}]} {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:37:10.846414 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [req-88d40fb2-e15d-483f-a8a8-3ff09b621925 req-2663f023-a041-42e2-8061-297630213bec service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:10.847162 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [req-88d40fb2-e15d-483f-a8a8-3ff09b621925 req-2663f023-a041-42e2-8061-297630213bec service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:10.859742 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.compute.server_external_events [req-88d40fb2-e15d-483f-a8a8-3ff09b621925 req-2663f023-a041-42e2-8061-297630213bec service nova] Creating event network-vif-unplugged:23d6a89e-f532-421c-8c67-0672e13b68a3 for instance 8ea882c7-9191-4712-91eb-a810e49b9e52 on hv-cinder-84112 May 19 13:37:10.865126 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [req-88d40fb2-e15d-483f-a8a8-3ff09b621925 req-2663f023-a041-42e2-8061-297630213bec service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032976 May 19 13:37:10.866084 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 338/690] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:37:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 13:37:11.082759 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-c55b2305-e01a-40d0-a804-85be6e003bd0 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:37:11.083423 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-c55b2305-e01a-40d0-a804-85be6e003bd0 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 8ea882c7-9191-4712-91eb-a810e49b9e52] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:37:11.090660 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-c55b2305-e01a-40d0-a804-85be6e003bd0 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:11.091091 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-c55b2305-e01a-40d0-a804-85be6e003bd0 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:11.092084 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-c55b2305-e01a-40d0-a804-85be6e003bd0 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:11.092502 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-c55b2305-e01a-40d0-a804-85be6e003bd0 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:11.121872 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [req-56ff4bdf-3a6d-486f-a5ee-beceae1001cf req-d578077a-e3f2-42e0-93bf-ef3ac25cb323 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b705092-099b-444c-81cf-ecfacd701ac1", "tag": "f893dedd-28aa-4e31-8cfb-add216f8a285"}]} {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:37:11.130769 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [req-56ff4bdf-3a6d-486f-a5ee-beceae1001cf req-d578077a-e3f2-42e0-93bf-ef3ac25cb323 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:11.131447 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [req-56ff4bdf-3a6d-486f-a5ee-beceae1001cf req-d578077a-e3f2-42e0-93bf-ef3ac25cb323 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:11.143300 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.compute.server_external_events [req-56ff4bdf-3a6d-486f-a5ee-beceae1001cf req-d578077a-e3f2-42e0-93bf-ef3ac25cb323 service nova] Creating event network-changed:f893dedd-28aa-4e31-8cfb-add216f8a285 for instance 5b705092-099b-444c-81cf-ecfacd701ac1 on hv-cinder-84112 May 19 13:37:11.159081 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [req-56ff4bdf-3a6d-486f-a5ee-beceae1001cf req-d578077a-e3f2-42e0-93bf-ef3ac25cb323 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041656 May 19 13:37:11.159980 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 339/691] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:37:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:37:11.247192 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-c55b2305-e01a-40d0-a804-85be6e003bd0 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:11.256511 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-c55b2305-e01a-40d0-a804-85be6e003bd0 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:11.258985 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-c55b2305-e01a-40d0-a804-85be6e003bd0 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:11.260535 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-c55b2305-e01a-40d0-a804-85be6e003bd0 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52" status: 200 len: 1722 microversion: 2.20 time: 0.182121 May 19 13:37:11.261757 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 353/692] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:37:11 2022] GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52 => generated 1722 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:37:12.279851 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-23e06509-fffb-44e4-b15e-1f62dc2659bb tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:37:12.280549 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-23e06509-fffb-44e4-b15e-1f62dc2659bb tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 8ea882c7-9191-4712-91eb-a810e49b9e52] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:37:12.287541 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-23e06509-fffb-44e4-b15e-1f62dc2659bb tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:12.287982 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-23e06509-fffb-44e4-b15e-1f62dc2659bb tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:12.288738 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-23e06509-fffb-44e4-b15e-1f62dc2659bb tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:12.289166 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-23e06509-fffb-44e4-b15e-1f62dc2659bb tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:12.423184 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-23e06509-fffb-44e4-b15e-1f62dc2659bb tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:12.431176 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-23e06509-fffb-44e4-b15e-1f62dc2659bb tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:12.432697 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-23e06509-fffb-44e4-b15e-1f62dc2659bb tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:12.433848 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-23e06509-fffb-44e4-b15e-1f62dc2659bb tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52" status: 200 len: 1665 microversion: 2.20 time: 0.158877 May 19 13:37:12.434396 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 340/693] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:37:12 2022] GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52 => generated 1665 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:37:12.451679 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-f59114a3-198b-47b2-9de9-e69947a9e564 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "713cda98-cbb6-4d5d-9fca-8b24cc9f8195"}} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:37:12.452791 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-f59114a3-198b-47b2-9de9-e69947a9e564 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 8ea882c7-9191-4712-91eb-a810e49b9e52] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:37:12.459545 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-f59114a3-198b-47b2-9de9-e69947a9e564 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:12.460245 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-f59114a3-198b-47b2-9de9-e69947a9e564 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:12.461005 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-f59114a3-198b-47b2-9de9-e69947a9e564 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:12.461447 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-f59114a3-198b-47b2-9de9-e69947a9e564 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:12.752556 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-f59114a3-198b-47b2-9de9-e69947a9e564 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "POST /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.304932 May 19 13:37:12.753159 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 354/694] 10.222.0.24 () {62 vars in 1363 bytes} [Thu May 19 13:37:12 2022] POST /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52/os-volume_attachments => generated 188 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 13:37:12.871080 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-f692c870-f52f-482e-80f1-7cc9075ccf9c tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:37:12.871542 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-f692c870-f52f-482e-80f1-7cc9075ccf9c tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 8ea882c7-9191-4712-91eb-a810e49b9e52] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:37:12.877880 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-f692c870-f52f-482e-80f1-7cc9075ccf9c tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:12.878322 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-f692c870-f52f-482e-80f1-7cc9075ccf9c tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:12.879069 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-f692c870-f52f-482e-80f1-7cc9075ccf9c tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:12.879497 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-f692c870-f52f-482e-80f1-7cc9075ccf9c tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:13.315767 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-f692c870-f52f-482e-80f1-7cc9075ccf9c tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "DELETE /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52/os-volume_attachments/713cda98-cbb6-4d5d-9fca-8b24cc9f8195" status: 202 len: 0 microversion: 2.20 time: 0.448461 May 19 13:37:13.316512 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 341/695] 10.222.0.24 () {60 vars in 1456 bytes} [Thu May 19 13:37:12 2022] DELETE /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52/os-volume_attachments/713cda98-cbb6-4d5d-9fca-8b24cc9f8195 => generated 0 bytes in 450 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 19 13:37:13.372638 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-cc197510-fb30-4ea5-8913-b750f1799582 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:37:13.373205 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-cc197510-fb30-4ea5-8913-b750f1799582 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 8ea882c7-9191-4712-91eb-a810e49b9e52] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:37:13.379485 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-cc197510-fb30-4ea5-8913-b750f1799582 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:13.379949 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-cc197510-fb30-4ea5-8913-b750f1799582 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:13.380713 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-cc197510-fb30-4ea5-8913-b750f1799582 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:13.381147 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-cc197510-fb30-4ea5-8913-b750f1799582 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:13.462077 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-cc197510-fb30-4ea5-8913-b750f1799582 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "POST /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52/action" status: 202 len: 0 microversion: 2.20 time: 0.093400 May 19 13:37:13.462760 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 355/696] 10.222.0.24 () {62 vars in 1318 bytes} [Thu May 19 13:37:13 2022] POST /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 19 13:37:13.471234 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-ad893002-75de-4c25-98f7-83e8226cb766 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:37:13.471852 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-ad893002-75de-4c25-98f7-83e8226cb766 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 8ea882c7-9191-4712-91eb-a810e49b9e52] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:37:13.479043 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-ad893002-75de-4c25-98f7-83e8226cb766 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:13.479484 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-ad893002-75de-4c25-98f7-83e8226cb766 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:13.480245 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-ad893002-75de-4c25-98f7-83e8226cb766 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:13.480667 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-ad893002-75de-4c25-98f7-83e8226cb766 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:13.622620 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-ad893002-75de-4c25-98f7-83e8226cb766 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:13.631828 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-ad893002-75de-4c25-98f7-83e8226cb766 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:13.633751 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-ad893002-75de-4c25-98f7-83e8226cb766 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:13.634991 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-ad893002-75de-4c25-98f7-83e8226cb766 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52" status: 200 len: 1673 microversion: 2.20 time: 0.168031 May 19 13:37:13.635558 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 342/697] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:37:13 2022] GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52 => generated 1673 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:37:14.655069 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-ce96f432-0ca8-4997-9e34-d6d5071e0c99 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:37:14.655660 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-ce96f432-0ca8-4997-9e34-d6d5071e0c99 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 8ea882c7-9191-4712-91eb-a810e49b9e52] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:37:14.662670 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-ce96f432-0ca8-4997-9e34-d6d5071e0c99 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:14.663124 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-ce96f432-0ca8-4997-9e34-d6d5071e0c99 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:14.663890 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-ce96f432-0ca8-4997-9e34-d6d5071e0c99 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:14.664327 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-ce96f432-0ca8-4997-9e34-d6d5071e0c99 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:14.807137 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-ce96f432-0ca8-4997-9e34-d6d5071e0c99 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:14.815736 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-ce96f432-0ca8-4997-9e34-d6d5071e0c99 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:14.817355 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-ce96f432-0ca8-4997-9e34-d6d5071e0c99 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:14.818596 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-ce96f432-0ca8-4997-9e34-d6d5071e0c99 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52" status: 200 len: 1675 microversion: 2.20 time: 0.168388 May 19 13:37:14.819162 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 356/698] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:37:14 2022] GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52 => generated 1675 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:37:15.839703 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-4035d174-a8a9-4d4c-b803-80befabac4a4 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:37:15.840546 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-4035d174-a8a9-4d4c-b803-80befabac4a4 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 8ea882c7-9191-4712-91eb-a810e49b9e52] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:37:15.847368 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-4035d174-a8a9-4d4c-b803-80befabac4a4 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:15.847813 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-4035d174-a8a9-4d4c-b803-80befabac4a4 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:15.848575 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-4035d174-a8a9-4d4c-b803-80befabac4a4 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:15.849009 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-4035d174-a8a9-4d4c-b803-80befabac4a4 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:15.983470 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-4035d174-a8a9-4d4c-b803-80befabac4a4 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:15.985892 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:37:15.994505 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-4035d174-a8a9-4d4c-b803-80befabac4a4 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:15.996333 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-4035d174-a8a9-4d4c-b803-80befabac4a4 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:15.997541 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-4035d174-a8a9-4d4c-b803-80befabac4a4 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52" status: 200 len: 1731 microversion: 2.20 time: 0.163457 May 19 13:37:15.998078 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 343/699] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:37:15 2022] GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52 => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:37:17.017126 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-b4099a19-94d4-41ff-bbe9-af318378e280 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:37:17.017740 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-b4099a19-94d4-41ff-bbe9-af318378e280 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 8ea882c7-9191-4712-91eb-a810e49b9e52] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:37:17.024514 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-b4099a19-94d4-41ff-bbe9-af318378e280 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:17.024952 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-b4099a19-94d4-41ff-bbe9-af318378e280 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:17.025747 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-b4099a19-94d4-41ff-bbe9-af318378e280 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:17.026175 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-b4099a19-94d4-41ff-bbe9-af318378e280 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:17.193937 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-b4099a19-94d4-41ff-bbe9-af318378e280 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:17.202455 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-b4099a19-94d4-41ff-bbe9-af318378e280 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:17.204067 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-b4099a19-94d4-41ff-bbe9-af318378e280 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:17.205583 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-b4099a19-94d4-41ff-bbe9-af318378e280 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52" status: 200 len: 1731 microversion: 2.20 time: 0.192580 May 19 13:37:17.206147 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 357/700] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:37:17 2022] GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52 => generated 1731 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:37:18.227520 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-33759b28-fd99-489c-ac7e-c682570dbd08 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:37:18.228323 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-33759b28-fd99-489c-ac7e-c682570dbd08 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 8ea882c7-9191-4712-91eb-a810e49b9e52] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:37:18.239104 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-33759b28-fd99-489c-ac7e-c682570dbd08 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:18.239607 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-33759b28-fd99-489c-ac7e-c682570dbd08 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:18.240595 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-33759b28-fd99-489c-ac7e-c682570dbd08 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:18.241113 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-33759b28-fd99-489c-ac7e-c682570dbd08 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:18.383841 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-33759b28-fd99-489c-ac7e-c682570dbd08 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:18.392042 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-33759b28-fd99-489c-ac7e-c682570dbd08 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:18.393698 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-33759b28-fd99-489c-ac7e-c682570dbd08 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:18.394856 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-33759b28-fd99-489c-ac7e-c682570dbd08 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52" status: 200 len: 1731 microversion: 2.20 time: 0.173967 May 19 13:37:18.395414 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 344/701] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:37:18 2022] GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52 => generated 1731 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:37:19.413629 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-21d04699-7204-4f01-86bb-85e9e40b13e3 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:37:19.414358 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-21d04699-7204-4f01-86bb-85e9e40b13e3 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 8ea882c7-9191-4712-91eb-a810e49b9e52] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:37:19.421222 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-21d04699-7204-4f01-86bb-85e9e40b13e3 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:19.421701 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-21d04699-7204-4f01-86bb-85e9e40b13e3 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:19.422459 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-21d04699-7204-4f01-86bb-85e9e40b13e3 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:19.422897 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-21d04699-7204-4f01-86bb-85e9e40b13e3 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:19.427675 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:37:19.563815 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-21d04699-7204-4f01-86bb-85e9e40b13e3 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:19.572262 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-21d04699-7204-4f01-86bb-85e9e40b13e3 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:19.573785 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-21d04699-7204-4f01-86bb-85e9e40b13e3 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:19.574942 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-21d04699-7204-4f01-86bb-85e9e40b13e3 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52" status: 200 len: 1731 microversion: 2.20 time: 0.166346 May 19 13:37:19.575501 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 358/702] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:37:19 2022] GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52 => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:37:20.593943 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-0f04aa9d-82c2-44a8-824d-33b85a3c20cf tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:37:20.594544 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-0f04aa9d-82c2-44a8-824d-33b85a3c20cf tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 8ea882c7-9191-4712-91eb-a810e49b9e52] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:37:20.601289 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-0f04aa9d-82c2-44a8-824d-33b85a3c20cf tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:20.601762 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-0f04aa9d-82c2-44a8-824d-33b85a3c20cf tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:20.602534 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-0f04aa9d-82c2-44a8-824d-33b85a3c20cf tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:20.602961 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-0f04aa9d-82c2-44a8-824d-33b85a3c20cf tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:20.739055 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-0f04aa9d-82c2-44a8-824d-33b85a3c20cf tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:20.747750 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-0f04aa9d-82c2-44a8-824d-33b85a3c20cf tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:20.749237 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-0f04aa9d-82c2-44a8-824d-33b85a3c20cf tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:20.750418 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-0f04aa9d-82c2-44a8-824d-33b85a3c20cf tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52" status: 200 len: 1731 microversion: 2.20 time: 0.160533 May 19 13:37:20.750974 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 345/703] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:37:20 2022] GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52 => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:37:21.770280 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-0f25c23b-dd43-454a-abf9-956419931716 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:37:21.770890 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-0f25c23b-dd43-454a-abf9-956419931716 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 8ea882c7-9191-4712-91eb-a810e49b9e52] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:37:21.778209 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-0f25c23b-dd43-454a-abf9-956419931716 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:21.778672 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-0f25c23b-dd43-454a-abf9-956419931716 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:21.779414 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-0f25c23b-dd43-454a-abf9-956419931716 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:21.779845 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-0f25c23b-dd43-454a-abf9-956419931716 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:21.920380 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-0f25c23b-dd43-454a-abf9-956419931716 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:21.928378 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-0f25c23b-dd43-454a-abf9-956419931716 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:21.929898 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-0f25c23b-dd43-454a-abf9-956419931716 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:21.931052 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-0f25c23b-dd43-454a-abf9-956419931716 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52" status: 200 len: 1731 microversion: 2.20 time: 0.165760 May 19 13:37:21.931611 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 359/704] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:37:21 2022] GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52 => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 13:37:22.952615 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-bd7a2823-748d-4f58-9845-aeb58a3ff1a4 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:37:22.953225 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-bd7a2823-748d-4f58-9845-aeb58a3ff1a4 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 8ea882c7-9191-4712-91eb-a810e49b9e52] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:37:22.961257 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-bd7a2823-748d-4f58-9845-aeb58a3ff1a4 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:22.961860 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-bd7a2823-748d-4f58-9845-aeb58a3ff1a4 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:22.962772 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-bd7a2823-748d-4f58-9845-aeb58a3ff1a4 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:22.963207 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-bd7a2823-748d-4f58-9845-aeb58a3ff1a4 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:23.115131 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-bd7a2823-748d-4f58-9845-aeb58a3ff1a4 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:23.125480 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-bd7a2823-748d-4f58-9845-aeb58a3ff1a4 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:23.126986 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-bd7a2823-748d-4f58-9845-aeb58a3ff1a4 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:23.128233 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-bd7a2823-748d-4f58-9845-aeb58a3ff1a4 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52" status: 200 len: 1731 microversion: 2.20 time: 0.181557 May 19 13:37:23.128910 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 346/705] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:37:22 2022] GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52 => generated 1731 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:37:24.153975 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-8b5a5f33-fa13-4af9-a86f-3f100f2faad7 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:37:24.154500 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-8b5a5f33-fa13-4af9-a86f-3f100f2faad7 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 8ea882c7-9191-4712-91eb-a810e49b9e52] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:37:24.161704 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-8b5a5f33-fa13-4af9-a86f-3f100f2faad7 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:24.162160 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-8b5a5f33-fa13-4af9-a86f-3f100f2faad7 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:24.162925 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-8b5a5f33-fa13-4af9-a86f-3f100f2faad7 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:24.163360 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-8b5a5f33-fa13-4af9-a86f-3f100f2faad7 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:24.301732 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-8b5a5f33-fa13-4af9-a86f-3f100f2faad7 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:24.314072 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-8b5a5f33-fa13-4af9-a86f-3f100f2faad7 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:24.316037 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-8b5a5f33-fa13-4af9-a86f-3f100f2faad7 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:24.317189 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-8b5a5f33-fa13-4af9-a86f-3f100f2faad7 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52" status: 200 len: 1731 microversion: 2.20 time: 0.167738 May 19 13:37:24.317750 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 360/706] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:37:24 2022] GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52 => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:37:25.340575 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-426a1d2f-7708-4ba5-a20f-1e7a1bcfba28 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:37:25.343262 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-426a1d2f-7708-4ba5-a20f-1e7a1bcfba28 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 8ea882c7-9191-4712-91eb-a810e49b9e52] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:37:25.350232 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=4 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:37:25.352634 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-426a1d2f-7708-4ba5-a20f-1e7a1bcfba28 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:25.353545 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-426a1d2f-7708-4ba5-a20f-1e7a1bcfba28 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:25.354781 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-426a1d2f-7708-4ba5-a20f-1e7a1bcfba28 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:25.355428 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-426a1d2f-7708-4ba5-a20f-1e7a1bcfba28 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:25.495656 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-426a1d2f-7708-4ba5-a20f-1e7a1bcfba28 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:25.504564 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-426a1d2f-7708-4ba5-a20f-1e7a1bcfba28 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:25.506113 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-426a1d2f-7708-4ba5-a20f-1e7a1bcfba28 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:25.507296 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-426a1d2f-7708-4ba5-a20f-1e7a1bcfba28 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52" status: 200 len: 1731 microversion: 2.20 time: 0.170746 May 19 13:37:25.507825 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 347/707] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:37:25 2022] GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52 => generated 1731 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:37:26.531846 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-e4105ede-f67c-4a1e-8d98-c0db790574a8 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:37:26.532565 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-e4105ede-f67c-4a1e-8d98-c0db790574a8 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 8ea882c7-9191-4712-91eb-a810e49b9e52] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:37:26.535407 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_api:SELECT=58 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:37:26.541151 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-e4105ede-f67c-4a1e-8d98-c0db790574a8 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:26.541640 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-e4105ede-f67c-4a1e-8d98-c0db790574a8 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:26.542396 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-e4105ede-f67c-4a1e-8d98-c0db790574a8 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:26.542823 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-e4105ede-f67c-4a1e-8d98-c0db790574a8 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:26.688714 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-e4105ede-f67c-4a1e-8d98-c0db790574a8 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:26.698660 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-e4105ede-f67c-4a1e-8d98-c0db790574a8 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:26.700207 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-e4105ede-f67c-4a1e-8d98-c0db790574a8 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:26.701434 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-e4105ede-f67c-4a1e-8d98-c0db790574a8 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52" status: 200 len: 1731 microversion: 2.20 time: 0.176317 May 19 13:37:26.702294 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 361/708] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:37:26 2022] GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52 => generated 1731 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:37:27.723583 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-0c78b9f7-b251-4600-8c62-af35cebf5f78 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:37:27.724225 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-0c78b9f7-b251-4600-8c62-af35cebf5f78 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 8ea882c7-9191-4712-91eb-a810e49b9e52] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:37:27.731477 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-0c78b9f7-b251-4600-8c62-af35cebf5f78 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:27.731926 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-0c78b9f7-b251-4600-8c62-af35cebf5f78 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:27.732700 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-0c78b9f7-b251-4600-8c62-af35cebf5f78 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:27.733129 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-0c78b9f7-b251-4600-8c62-af35cebf5f78 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:27.887293 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-0c78b9f7-b251-4600-8c62-af35cebf5f78 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:27.895995 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-0c78b9f7-b251-4600-8c62-af35cebf5f78 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:27.897548 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-0c78b9f7-b251-4600-8c62-af35cebf5f78 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:27.898711 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-0c78b9f7-b251-4600-8c62-af35cebf5f78 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52" status: 200 len: 1731 microversion: 2.20 time: 0.181117 May 19 13:37:27.899263 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 348/709] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:37:27 2022] GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52 => generated 1731 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:37:28.922791 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-e5fe2795-d09a-4435-8652-a4f727bacb1b tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:37:28.923715 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-e5fe2795-d09a-4435-8652-a4f727bacb1b tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 8ea882c7-9191-4712-91eb-a810e49b9e52] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:37:28.932309 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-e5fe2795-d09a-4435-8652-a4f727bacb1b tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:28.932761 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-e5fe2795-d09a-4435-8652-a4f727bacb1b tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:28.933555 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-e5fe2795-d09a-4435-8652-a4f727bacb1b tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:28.933990 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-e5fe2795-d09a-4435-8652-a4f727bacb1b tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:29.094907 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-e5fe2795-d09a-4435-8652-a4f727bacb1b tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:29.104983 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-e5fe2795-d09a-4435-8652-a4f727bacb1b tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:29.106533 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-e5fe2795-d09a-4435-8652-a4f727bacb1b tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:29.107690 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-e5fe2795-d09a-4435-8652-a4f727bacb1b tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52" status: 200 len: 1731 microversion: 2.20 time: 0.192169 May 19 13:37:29.108258 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 362/710] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:37:28 2022] GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52 => generated 1731 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:37:30.130063 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-446e26c8-6cf7-44a1-9fc8-df4bbd6757fd tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:37:30.131549 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-446e26c8-6cf7-44a1-9fc8-df4bbd6757fd tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 8ea882c7-9191-4712-91eb-a810e49b9e52] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:37:30.138692 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-446e26c8-6cf7-44a1-9fc8-df4bbd6757fd tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:30.139159 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-446e26c8-6cf7-44a1-9fc8-df4bbd6757fd tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:30.139930 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-446e26c8-6cf7-44a1-9fc8-df4bbd6757fd tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:30.140521 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-446e26c8-6cf7-44a1-9fc8-df4bbd6757fd tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:30.281987 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-446e26c8-6cf7-44a1-9fc8-df4bbd6757fd tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:30.290914 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-446e26c8-6cf7-44a1-9fc8-df4bbd6757fd tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:30.292436 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-446e26c8-6cf7-44a1-9fc8-df4bbd6757fd tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:30.293662 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-446e26c8-6cf7-44a1-9fc8-df4bbd6757fd tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52" status: 200 len: 1731 microversion: 2.20 time: 0.170218 May 19 13:37:30.294244 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 349/711] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:37:30 2022] GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52 => generated 1731 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:37:31.314953 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-bfa9c999-4b53-41f4-9e23-6a57fffb65f5 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:37:31.315750 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-bfa9c999-4b53-41f4-9e23-6a57fffb65f5 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 8ea882c7-9191-4712-91eb-a810e49b9e52] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:37:31.325453 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-bfa9c999-4b53-41f4-9e23-6a57fffb65f5 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:31.326119 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-bfa9c999-4b53-41f4-9e23-6a57fffb65f5 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:31.327124 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-bfa9c999-4b53-41f4-9e23-6a57fffb65f5 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:31.327703 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-bfa9c999-4b53-41f4-9e23-6a57fffb65f5 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:31.470995 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-bfa9c999-4b53-41f4-9e23-6a57fffb65f5 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:31.479331 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-bfa9c999-4b53-41f4-9e23-6a57fffb65f5 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:31.480865 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-bfa9c999-4b53-41f4-9e23-6a57fffb65f5 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:31.482083 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-bfa9c999-4b53-41f4-9e23-6a57fffb65f5 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52" status: 200 len: 1731 microversion: 2.20 time: 0.172395 May 19 13:37:31.482618 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 363/712] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:37:31 2022] GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52 => generated 1731 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:37:32.504100 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-88f40f05-f215-42af-b5c8-ea4d71faff3c tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:37:32.505050 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-88f40f05-f215-42af-b5c8-ea4d71faff3c tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 8ea882c7-9191-4712-91eb-a810e49b9e52] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:37:32.516680 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-88f40f05-f215-42af-b5c8-ea4d71faff3c tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:32.517369 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-88f40f05-f215-42af-b5c8-ea4d71faff3c tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:32.518672 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-88f40f05-f215-42af-b5c8-ea4d71faff3c tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:32.519395 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-88f40f05-f215-42af-b5c8-ea4d71faff3c tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:32.658197 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-88f40f05-f215-42af-b5c8-ea4d71faff3c tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:32.670453 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-88f40f05-f215-42af-b5c8-ea4d71faff3c tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:32.672495 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-88f40f05-f215-42af-b5c8-ea4d71faff3c tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:32.674292 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-88f40f05-f215-42af-b5c8-ea4d71faff3c tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52" status: 200 len: 1731 microversion: 2.20 time: 0.176567 May 19 13:37:32.675046 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 350/713] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:37:32 2022] GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52 => generated 1731 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:37:33.004782 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [req-b501d98d-d603-490b-a24a-36fd510a56c6 req-d7906fbd-0865-4723-b2c9-069d7391fbd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ea882c7-9191-4712-91eb-a810e49b9e52", "name": "network-vif-plugged", "status": "completed", "tag": "23d6a89e-f532-421c-8c67-0672e13b68a3"}]} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:37:33.015437 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-b501d98d-d603-490b-a24a-36fd510a56c6 req-d7906fbd-0865-4723-b2c9-069d7391fbd0 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:33.015872 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-b501d98d-d603-490b-a24a-36fd510a56c6 req-d7906fbd-0865-4723-b2c9-069d7391fbd0 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:33.031395 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.compute.server_external_events [req-b501d98d-d603-490b-a24a-36fd510a56c6 req-d7906fbd-0865-4723-b2c9-069d7391fbd0 service nova] Creating event network-vif-plugged:23d6a89e-f532-421c-8c67-0672e13b68a3 for instance 8ea882c7-9191-4712-91eb-a810e49b9e52 on hv-cinder-84112 May 19 13:37:33.036456 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [req-b501d98d-d603-490b-a24a-36fd510a56c6 req-d7906fbd-0865-4723-b2c9-069d7391fbd0 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046655 May 19 13:37:33.037126 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 364/714] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:37:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:37:33.694877 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-76f2c676-e693-4b70-bf13-bf6e960c9cf8 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:37:33.695677 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-76f2c676-e693-4b70-bf13-bf6e960c9cf8 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 8ea882c7-9191-4712-91eb-a810e49b9e52] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:37:33.702168 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-76f2c676-e693-4b70-bf13-bf6e960c9cf8 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:33.702622 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-76f2c676-e693-4b70-bf13-bf6e960c9cf8 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:33.703421 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-76f2c676-e693-4b70-bf13-bf6e960c9cf8 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:33.703824 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-76f2c676-e693-4b70-bf13-bf6e960c9cf8 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:33.840060 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-76f2c676-e693-4b70-bf13-bf6e960c9cf8 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:33.848347 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-76f2c676-e693-4b70-bf13-bf6e960c9cf8 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:33.849891 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-76f2c676-e693-4b70-bf13-bf6e960c9cf8 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:33.851194 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-76f2c676-e693-4b70-bf13-bf6e960c9cf8 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52" status: 200 len: 1731 microversion: 2.20 time: 0.161448 May 19 13:37:33.851756 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 351/715] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:37:33 2022] GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52 => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:37:34.871344 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-65c632c9-486e-4439-8560-6488ee238a1e tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:37:34.872035 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-65c632c9-486e-4439-8560-6488ee238a1e tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 8ea882c7-9191-4712-91eb-a810e49b9e52] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:37:34.878444 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-65c632c9-486e-4439-8560-6488ee238a1e tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:34.878896 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-65c632c9-486e-4439-8560-6488ee238a1e tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:34.879683 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-65c632c9-486e-4439-8560-6488ee238a1e tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:34.880118 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-65c632c9-486e-4439-8560-6488ee238a1e tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:35.019393 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-65c632c9-486e-4439-8560-6488ee238a1e tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:35.028649 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-65c632c9-486e-4439-8560-6488ee238a1e tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:35.030204 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-65c632c9-486e-4439-8560-6488ee238a1e tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:35.031371 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-65c632c9-486e-4439-8560-6488ee238a1e tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52" status: 200 len: 1731 microversion: 2.20 time: 0.164865 May 19 13:37:35.031935 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 365/716] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:37:34 2022] GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52 => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:37:36.055484 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-34415369-b629-4441-b0b9-d17f7ddff83c tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:37:36.056582 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-34415369-b629-4441-b0b9-d17f7ddff83c tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 8ea882c7-9191-4712-91eb-a810e49b9e52] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:37:36.067574 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-34415369-b629-4441-b0b9-d17f7ddff83c tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:36.068569 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-34415369-b629-4441-b0b9-d17f7ddff83c tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:36.069345 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-34415369-b629-4441-b0b9-d17f7ddff83c tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:36.069819 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-34415369-b629-4441-b0b9-d17f7ddff83c tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:36.216005 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-34415369-b629-4441-b0b9-d17f7ddff83c tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:36.226896 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-34415369-b629-4441-b0b9-d17f7ddff83c tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:36.228426 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-34415369-b629-4441-b0b9-d17f7ddff83c tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:36.229652 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-34415369-b629-4441-b0b9-d17f7ddff83c tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52" status: 200 len: 1718 microversion: 2.20 time: 0.181273 May 19 13:37:36.230206 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 352/717] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:37:36 2022] GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52 => generated 1718 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:37:47.252720 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-3e1e0bac-52c6-45ff-8f25-df8a13be1844 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:37:47.253400 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-3e1e0bac-52c6-45ff-8f25-df8a13be1844 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [instance: 5b705092-099b-444c-81cf-ecfacd701ac1] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:37:47.255580 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_api:SELECT=9 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:37:47.256364 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_cell1:SELECT=42 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:37:47.263266 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-3e1e0bac-52c6-45ff-8f25-df8a13be1844 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:47.263266 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-3e1e0bac-52c6-45ff-8f25-df8a13be1844 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:47.263929 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-3e1e0bac-52c6-45ff-8f25-df8a13be1844 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:47.264363 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-3e1e0bac-52c6-45ff-8f25-df8a13be1844 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:47.288315 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-3e1e0bac-52c6-45ff-8f25-df8a13be1844 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "GET /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1/ips" status: 200 len: 145 microversion: 2.1 time: 0.039938 May 19 13:37:47.288896 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 366/718] 10.222.0.24 () {58 vars in 1247 bytes} [Thu May 19 13:37:47 2022] GET /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1/ips => generated 145 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:37:50.334292 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-f346cbf1-ac79-4a87-a80a-6306697685e9 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eae6ee9c-7647-49cc-aac8-7d3f9b880948"}} {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:37:50.335737 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-f346cbf1-ac79-4a87-a80a-6306697685e9 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [instance: 5b705092-099b-444c-81cf-ecfacd701ac1] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:37:50.339647 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_api:SELECT=11 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:37:50.340507 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_cell1:SELECT=55 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:37:50.347293 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-f346cbf1-ac79-4a87-a80a-6306697685e9 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:50.347741 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-f346cbf1-ac79-4a87-a80a-6306697685e9 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:50.348513 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-f346cbf1-ac79-4a87-a80a-6306697685e9 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:50.348947 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-f346cbf1-ac79-4a87-a80a-6306697685e9 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:50.639824 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-f346cbf1-ac79-4a87-a80a-6306697685e9 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "POST /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.311903 May 19 13:37:50.640686 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 353/719] 10.222.0.24 () {60 vars in 1322 bytes} [Thu May 19 13:37:50 2022] POST /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1/os-volume_attachments => generated 194 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:37:58.188428 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-dfe3d171-b94a-40c0-ab45-97b875f1b4f3 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:37:58.191095 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_api:SELECT=2 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:37:58.191748 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_cell1:SELECT=4 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:37:58.197228 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-dfe3d171-b94a-40c0-ab45-97b875f1b4f3 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:58.197708 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-dfe3d171-b94a-40c0-ab45-97b875f1b4f3 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:58.256204 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-dfe3d171-b94a-40c0-ab45-97b875f1b4f3 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [instance: 5b705092-099b-444c-81cf-ecfacd701ac1] Going to try to stop instance {{(pid=120471) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 19 13:37:58.311736 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-dfe3d171-b94a-40c0-ab45-97b875f1b4f3 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "POST /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1/action" status: 202 len: 0 microversion: 2.1 time: 0.127121 May 19 13:37:58.312381 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 367/720] 10.222.0.24 () {60 vars in 1277 bytes} [Thu May 19 13:37:58 2022] POST /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 13:37:58.321494 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-72311767-a901-49a2-81ef-662ef047e95b tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:37:58.322311 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-72311767-a901-49a2-81ef-662ef047e95b tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [instance: 5b705092-099b-444c-81cf-ecfacd701ac1] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:37:58.329092 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-72311767-a901-49a2-81ef-662ef047e95b tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:58.329486 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-72311767-a901-49a2-81ef-662ef047e95b tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:58.330227 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-72311767-a901-49a2-81ef-662ef047e95b tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:58.330659 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-72311767-a901-49a2-81ef-662ef047e95b tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:58.461063 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-72311767-a901-49a2-81ef-662ef047e95b tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883da006d3f4aec8805c74cf5ffae86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1222038740244f69a977fe658d9bfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:58.471766 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-72311767-a901-49a2-81ef-662ef047e95b tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "GET /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1" status: 200 len: 1723 microversion: 2.1 time: 0.154927 May 19 13:37:58.472309 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 354/721] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:37:58 2022] GET /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:37:59.492569 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-a47fd2fc-fe09-4907-ab2f-73e5b1b181ae tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:37:59.493318 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-a47fd2fc-fe09-4907-ab2f-73e5b1b181ae tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [instance: 5b705092-099b-444c-81cf-ecfacd701ac1] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:37:59.502556 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-a47fd2fc-fe09-4907-ab2f-73e5b1b181ae tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:59.503130 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-a47fd2fc-fe09-4907-ab2f-73e5b1b181ae tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:59.504196 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-a47fd2fc-fe09-4907-ab2f-73e5b1b181ae tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:37:59.504818 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-a47fd2fc-fe09-4907-ab2f-73e5b1b181ae tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:37:59.646373 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-a47fd2fc-fe09-4907-ab2f-73e5b1b181ae tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883da006d3f4aec8805c74cf5ffae86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1222038740244f69a977fe658d9bfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:37:59.654984 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-a47fd2fc-fe09-4907-ab2f-73e5b1b181ae tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "GET /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1" status: 200 len: 1723 microversion: 2.1 time: 0.169550 May 19 13:37:59.657603 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 368/722] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:37:59 2022] GET /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:38:00.675365 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-a23242b9-5d80-47f5-8c6c-60d2f91a436e tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:38:00.676192 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-a23242b9-5d80-47f5-8c6c-60d2f91a436e tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [instance: 5b705092-099b-444c-81cf-ecfacd701ac1] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:38:00.685544 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-a23242b9-5d80-47f5-8c6c-60d2f91a436e tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:38:00.686718 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-a23242b9-5d80-47f5-8c6c-60d2f91a436e tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:38:00.687509 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-a23242b9-5d80-47f5-8c6c-60d2f91a436e tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:38:00.687940 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-a23242b9-5d80-47f5-8c6c-60d2f91a436e tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:38:01.096067 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-a23242b9-5d80-47f5-8c6c-60d2f91a436e tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883da006d3f4aec8805c74cf5ffae86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1222038740244f69a977fe658d9bfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:38:01.108521 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-a23242b9-5d80-47f5-8c6c-60d2f91a436e tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "GET /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1" status: 200 len: 1723 microversion: 2.1 time: 0.439287 May 19 13:38:01.109086 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 355/723] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:38:00 2022] GET /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1 => generated 1723 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:38:02.129281 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-fe3c96f1-ca01-4167-888b-30cff9b566e4 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:38:02.130271 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-fe3c96f1-ca01-4167-888b-30cff9b566e4 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [instance: 5b705092-099b-444c-81cf-ecfacd701ac1] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:38:02.139346 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-fe3c96f1-ca01-4167-888b-30cff9b566e4 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:38:02.140290 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-fe3c96f1-ca01-4167-888b-30cff9b566e4 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:38:02.141321 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-fe3c96f1-ca01-4167-888b-30cff9b566e4 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:38:02.141949 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-fe3c96f1-ca01-4167-888b-30cff9b566e4 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:38:02.289281 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-fe3c96f1-ca01-4167-888b-30cff9b566e4 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883da006d3f4aec8805c74cf5ffae86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1222038740244f69a977fe658d9bfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:38:02.298829 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-fe3c96f1-ca01-4167-888b-30cff9b566e4 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "GET /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1" status: 200 len: 1723 microversion: 2.1 time: 0.175297 May 19 13:38:02.299403 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 369/724] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:38:02 2022] GET /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:38:03.321823 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-b7fbf634-e350-4af0-9059-c9b7a8df2495 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:38:03.322711 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-b7fbf634-e350-4af0-9059-c9b7a8df2495 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [instance: 5b705092-099b-444c-81cf-ecfacd701ac1] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:38:03.331260 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-b7fbf634-e350-4af0-9059-c9b7a8df2495 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:38:03.331702 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-b7fbf634-e350-4af0-9059-c9b7a8df2495 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:38:03.332453 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-b7fbf634-e350-4af0-9059-c9b7a8df2495 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:38:03.332876 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-b7fbf634-e350-4af0-9059-c9b7a8df2495 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:38:03.464547 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-b7fbf634-e350-4af0-9059-c9b7a8df2495 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883da006d3f4aec8805c74cf5ffae86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1222038740244f69a977fe658d9bfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:38:03.473612 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-b7fbf634-e350-4af0-9059-c9b7a8df2495 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "GET /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1" status: 200 len: 1723 microversion: 2.1 time: 0.158215 May 19 13:38:03.474212 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 356/725] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:38:03 2022] GET /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:38:04.495329 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-81ad5f3e-f05b-45aa-9be0-053ce0f76492 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:38:04.496249 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-81ad5f3e-f05b-45aa-9be0-053ce0f76492 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [instance: 5b705092-099b-444c-81cf-ecfacd701ac1] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:38:04.504285 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-81ad5f3e-f05b-45aa-9be0-053ce0f76492 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:38:04.504736 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-81ad5f3e-f05b-45aa-9be0-053ce0f76492 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:38:04.505535 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-81ad5f3e-f05b-45aa-9be0-053ce0f76492 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:38:04.505959 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-81ad5f3e-f05b-45aa-9be0-053ce0f76492 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:38:04.654380 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-81ad5f3e-f05b-45aa-9be0-053ce0f76492 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883da006d3f4aec8805c74cf5ffae86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1222038740244f69a977fe658d9bfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:38:04.667566 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-81ad5f3e-f05b-45aa-9be0-053ce0f76492 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "GET /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1" status: 200 len: 1723 microversion: 2.1 time: 0.178485 May 19 13:38:04.668344 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 370/726] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:38:04 2022] GET /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1 => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:38:05.686296 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-e7ab755b-d0cd-4373-bc69-7700fd7edc0a tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:38:05.687559 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-e7ab755b-d0cd-4373-bc69-7700fd7edc0a tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [instance: 5b705092-099b-444c-81cf-ecfacd701ac1] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:38:05.694653 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-e7ab755b-d0cd-4373-bc69-7700fd7edc0a tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:38:05.695097 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-e7ab755b-d0cd-4373-bc69-7700fd7edc0a tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:38:05.695866 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-e7ab755b-d0cd-4373-bc69-7700fd7edc0a tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:38:05.696294 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-e7ab755b-d0cd-4373-bc69-7700fd7edc0a tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:38:05.857396 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-e7ab755b-d0cd-4373-bc69-7700fd7edc0a tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883da006d3f4aec8805c74cf5ffae86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1222038740244f69a977fe658d9bfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:38:05.869267 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-e7ab755b-d0cd-4373-bc69-7700fd7edc0a tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "GET /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1" status: 200 len: 1723 microversion: 2.1 time: 0.186997 May 19 13:38:05.869964 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 357/727] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:38:05 2022] GET /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1 => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:38:06.888732 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-51282c3a-9a65-4918-9e3d-e1acb30ace63 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:38:06.889841 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-51282c3a-9a65-4918-9e3d-e1acb30ace63 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [instance: 5b705092-099b-444c-81cf-ecfacd701ac1] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:38:06.896705 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-51282c3a-9a65-4918-9e3d-e1acb30ace63 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:38:06.897145 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-51282c3a-9a65-4918-9e3d-e1acb30ace63 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:38:06.897933 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-51282c3a-9a65-4918-9e3d-e1acb30ace63 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:38:06.898373 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-51282c3a-9a65-4918-9e3d-e1acb30ace63 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:38:07.033783 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-51282c3a-9a65-4918-9e3d-e1acb30ace63 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883da006d3f4aec8805c74cf5ffae86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1222038740244f69a977fe658d9bfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:38:07.042276 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-51282c3a-9a65-4918-9e3d-e1acb30ace63 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "GET /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1" status: 200 len: 1723 microversion: 2.1 time: 0.157833 May 19 13:38:07.042885 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 371/728] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:38:06 2022] GET /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:38:08.060530 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-4fc82480-ce9b-424a-9925-8a2ab9a01c77 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:38:08.061126 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-4fc82480-ce9b-424a-9925-8a2ab9a01c77 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [instance: 5b705092-099b-444c-81cf-ecfacd701ac1] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:38:08.068908 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-4fc82480-ce9b-424a-9925-8a2ab9a01c77 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:38:08.069361 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-4fc82480-ce9b-424a-9925-8a2ab9a01c77 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:38:08.070155 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-4fc82480-ce9b-424a-9925-8a2ab9a01c77 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:38:08.070596 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-4fc82480-ce9b-424a-9925-8a2ab9a01c77 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:38:08.203714 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-4fc82480-ce9b-424a-9925-8a2ab9a01c77 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883da006d3f4aec8805c74cf5ffae86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1222038740244f69a977fe658d9bfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:38:08.212075 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-4fc82480-ce9b-424a-9925-8a2ab9a01c77 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "GET /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1" status: 200 len: 1723 microversion: 2.1 time: 0.155526 May 19 13:38:08.212647 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 358/729] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:38:08 2022] GET /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:38:08.721707 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-e3ae8c23-615c-4161-a1f9-574cc8efb0d3 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:38:08.722799 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-e3ae8c23-615c-4161-a1f9-574cc8efb0d3 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 8ea882c7-9191-4712-91eb-a810e49b9e52] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:38:08.729856 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-e3ae8c23-615c-4161-a1f9-574cc8efb0d3 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:38:08.730387 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-e3ae8c23-615c-4161-a1f9-574cc8efb0d3 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:38:08.731217 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-e3ae8c23-615c-4161-a1f9-574cc8efb0d3 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:38:08.731708 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-e3ae8c23-615c-4161-a1f9-574cc8efb0d3 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:38:08.761860 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-e3ae8c23-615c-4161-a1f9-574cc8efb0d3 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044293 May 19 13:38:08.762411 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 372/730] 10.222.0.24 () {60 vars in 1342 bytes} [Thu May 19 13:38:08 2022] GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:38:08.819626 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-5fdc1b5a-e767-4288-91a7-b3dace0a1a74 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:38:08.820113 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-5fdc1b5a-e767-4288-91a7-b3dace0a1a74 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 8ea882c7-9191-4712-91eb-a810e49b9e52] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:38:08.826218 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-5fdc1b5a-e767-4288-91a7-b3dace0a1a74 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:38:08.826660 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-5fdc1b5a-e767-4288-91a7-b3dace0a1a74 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:38:08.827455 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-5fdc1b5a-e767-4288-91a7-b3dace0a1a74 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:38:08.827878 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-5fdc1b5a-e767-4288-91a7-b3dace0a1a74 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:38:08.854982 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-5fdc1b5a-e767-4288-91a7-b3dace0a1a74 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 8ea882c7-9191-4712-91eb-a810e49b9e52] Going to try to terminate instance {{(pid=120472) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 13:38:08.931713 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-5fdc1b5a-e767-4288-91a7-b3dace0a1a74 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "DELETE /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52" status: 204 len: 0 microversion: 2.20 time: 0.115674 May 19 13:38:08.932201 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 359/731] 10.222.0.24 () {60 vars in 1279 bytes} [Thu May 19 13:38:08 2022] DELETE /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 19 13:38:08.940809 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-ed954ad0-591e-450a-97f2-efbd7d82c4d5 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:38:08.941404 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-ed954ad0-591e-450a-97f2-efbd7d82c4d5 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 8ea882c7-9191-4712-91eb-a810e49b9e52] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:38:08.947416 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-ed954ad0-591e-450a-97f2-efbd7d82c4d5 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:38:08.947851 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-ed954ad0-591e-450a-97f2-efbd7d82c4d5 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:38:08.948597 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-ed954ad0-591e-450a-97f2-efbd7d82c4d5 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:38:08.949020 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-ed954ad0-591e-450a-97f2-efbd7d82c4d5 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:38:09.100558 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-ed954ad0-591e-450a-97f2-efbd7d82c4d5 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:38:09.111089 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-ed954ad0-591e-450a-97f2-efbd7d82c4d5 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:38:09.112554 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-ed954ad0-591e-450a-97f2-efbd7d82c4d5 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:38:09.113760 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-ed954ad0-591e-450a-97f2-efbd7d82c4d5 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52" status: 200 len: 1724 microversion: 2.20 time: 0.177213 May 19 13:38:09.114312 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 373/732] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:38:08 2022] GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52 => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 13:38:09.230835 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-d23cbdbe-55e2-41a9-9bb7-9bafeae65384 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:38:09.231414 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-d23cbdbe-55e2-41a9-9bb7-9bafeae65384 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [instance: 5b705092-099b-444c-81cf-ecfacd701ac1] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:38:09.238533 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-d23cbdbe-55e2-41a9-9bb7-9bafeae65384 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:38:09.238968 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-d23cbdbe-55e2-41a9-9bb7-9bafeae65384 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:38:09.239727 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-d23cbdbe-55e2-41a9-9bb7-9bafeae65384 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:38:09.240148 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-d23cbdbe-55e2-41a9-9bb7-9bafeae65384 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:38:09.396137 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-d23cbdbe-55e2-41a9-9bb7-9bafeae65384 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883da006d3f4aec8805c74cf5ffae86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1222038740244f69a977fe658d9bfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:38:09.405677 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-d23cbdbe-55e2-41a9-9bb7-9bafeae65384 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "GET /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1" status: 200 len: 1700 microversion: 2.1 time: 0.178862 May 19 13:38:09.406338 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 360/733] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:38:09 2022] GET /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1 => generated 1700 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:38:09.426797 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-960ead17-85ff-4bc6-a68d-e7e8ba8d5916 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:38:09.432873 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-960ead17-85ff-4bc6-a68d-e7e8ba8d5916 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:38:09.433316 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-960ead17-85ff-4bc6-a68d-e7e8ba8d5916 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:38:09.457271 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-960ead17-85ff-4bc6-a68d-e7e8ba8d5916 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [instance: 5b705092-099b-444c-81cf-ecfacd701ac1] Going to try to start instance {{(pid=120471) start /opt/stack/nova/nova/compute/api.py:2730}} May 19 13:38:09.508708 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-960ead17-85ff-4bc6-a68d-e7e8ba8d5916 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "POST /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1/action" status: 202 len: 0 microversion: 2.1 time: 0.085689 May 19 13:38:09.509307 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 374/734] 10.222.0.24 () {60 vars in 1277 bytes} [Thu May 19 13:38:09 2022] POST /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 13:38:09.520727 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-036e6d2e-2ac4-4c59-ad42-3adb92d23e65 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:38:09.521340 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-036e6d2e-2ac4-4c59-ad42-3adb92d23e65 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [instance: 5b705092-099b-444c-81cf-ecfacd701ac1] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:38:09.527724 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-036e6d2e-2ac4-4c59-ad42-3adb92d23e65 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:38:09.528182 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-036e6d2e-2ac4-4c59-ad42-3adb92d23e65 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:38:09.528946 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-036e6d2e-2ac4-4c59-ad42-3adb92d23e65 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:38:09.529375 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-036e6d2e-2ac4-4c59-ad42-3adb92d23e65 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:38:09.682048 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-036e6d2e-2ac4-4c59-ad42-3adb92d23e65 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883da006d3f4aec8805c74cf5ffae86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1222038740244f69a977fe658d9bfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:38:09.691046 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-036e6d2e-2ac4-4c59-ad42-3adb92d23e65 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "GET /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1" status: 200 len: 1709 microversion: 2.1 time: 0.177470 May 19 13:38:09.691661 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 361/735] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:38:09 2022] GET /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1 => generated 1709 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:38:10.133632 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-7d82e59d-6a07-45ac-ae72-8b398d20b899 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:38:10.134327 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-7d82e59d-6a07-45ac-ae72-8b398d20b899 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 8ea882c7-9191-4712-91eb-a810e49b9e52] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:38:10.141808 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-7d82e59d-6a07-45ac-ae72-8b398d20b899 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:38:10.142264 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-7d82e59d-6a07-45ac-ae72-8b398d20b899 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:38:10.143026 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-7d82e59d-6a07-45ac-ae72-8b398d20b899 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:38:10.143451 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-7d82e59d-6a07-45ac-ae72-8b398d20b899 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:38:10.311749 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-7d82e59d-6a07-45ac-ae72-8b398d20b899 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:38:10.320291 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-7d82e59d-6a07-45ac-ae72-8b398d20b899 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:38:10.321832 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-7d82e59d-6a07-45ac-ae72-8b398d20b899 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:38:10.322999 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-7d82e59d-6a07-45ac-ae72-8b398d20b899 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52" status: 200 len: 1724 microversion: 2.20 time: 0.194384 May 19 13:38:10.323564 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 375/736] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:38:10 2022] GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52 => generated 1724 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:38:10.709197 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-93e7e433-61cb-47bf-b8d5-0990df1d4ae8 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:38:10.709847 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-93e7e433-61cb-47bf-b8d5-0990df1d4ae8 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [instance: 5b705092-099b-444c-81cf-ecfacd701ac1] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:38:10.716931 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-93e7e433-61cb-47bf-b8d5-0990df1d4ae8 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:38:10.717375 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-93e7e433-61cb-47bf-b8d5-0990df1d4ae8 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:38:10.718300 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-93e7e433-61cb-47bf-b8d5-0990df1d4ae8 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:38:10.718733 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-93e7e433-61cb-47bf-b8d5-0990df1d4ae8 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:38:10.935987 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-93e7e433-61cb-47bf-b8d5-0990df1d4ae8 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883da006d3f4aec8805c74cf5ffae86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1222038740244f69a977fe658d9bfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:38:10.944426 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-93e7e433-61cb-47bf-b8d5-0990df1d4ae8 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "GET /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1" status: 200 len: 1709 microversion: 2.1 time: 0.239962 May 19 13:38:10.945085 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 362/737] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:38:10 2022] GET /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1 => generated 1709 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:38:11.332195 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [req-60f62f3e-4890-432b-b61d-4b3ba10cfae0 req-1e9c9fac-98e8-4b66-85c5-ebb983e3a19b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ea882c7-9191-4712-91eb-a810e49b9e52", "name": "network-vif-deleted", "tag": "23d6a89e-f532-421c-8c67-0672e13b68a3"}]} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:38:11.340012 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-8d1345fd-2eaf-40d0-90c8-b1e132b4fac1 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:38:11.340606 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-8d1345fd-2eaf-40d0-90c8-b1e132b4fac1 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 8ea882c7-9191-4712-91eb-a810e49b9e52] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:38:11.341293 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-60f62f3e-4890-432b-b61d-4b3ba10cfae0 req-1e9c9fac-98e8-4b66-85c5-ebb983e3a19b service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:38:11.342000 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-60f62f3e-4890-432b-b61d-4b3ba10cfae0 req-1e9c9fac-98e8-4b66-85c5-ebb983e3a19b service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:38:11.347185 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-8d1345fd-2eaf-40d0-90c8-b1e132b4fac1 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:38:11.347185 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-8d1345fd-2eaf-40d0-90c8-b1e132b4fac1 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:38:11.347937 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-8d1345fd-2eaf-40d0-90c8-b1e132b4fac1 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:38:11.348352 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-8d1345fd-2eaf-40d0-90c8-b1e132b4fac1 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:38:11.359943 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.compute.server_external_events [req-60f62f3e-4890-432b-b61d-4b3ba10cfae0 req-1e9c9fac-98e8-4b66-85c5-ebb983e3a19b service nova] Creating event network-vif-deleted:23d6a89e-f532-421c-8c67-0672e13b68a3 for instance 8ea882c7-9191-4712-91eb-a810e49b9e52 on hv-cinder-84112 May 19 13:38:11.373995 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [req-60f62f3e-4890-432b-b61d-4b3ba10cfae0 req-1e9c9fac-98e8-4b66-85c5-ebb983e3a19b service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045581 May 19 13:38:11.375401 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 376/738] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:38:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:38:11.414423 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-8d1345fd-2eaf-40d0-90c8-b1e132b4fac1 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:38:11.424482 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-8d1345fd-2eaf-40d0-90c8-b1e132b4fac1 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:38:11.426244 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-8d1345fd-2eaf-40d0-90c8-b1e132b4fac1 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14da69798e344e70ba64bf8187523e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959c5c84bd724d2688f435b15b41f1c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:38:11.427524 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-8d1345fd-2eaf-40d0-90c8-b1e132b4fac1 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52" status: 200 len: 1656 microversion: 2.20 time: 0.091375 May 19 13:38:11.428439 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 363/739] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:38:11 2022] GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52 => generated 1656 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:38:11.962469 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-a6c2d9b8-ca79-46d8-bde2-c6619fec5a7b tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:38:11.963658 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-a6c2d9b8-ca79-46d8-bde2-c6619fec5a7b tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [instance: 5b705092-099b-444c-81cf-ecfacd701ac1] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:38:11.970414 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-a6c2d9b8-ca79-46d8-bde2-c6619fec5a7b tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:38:11.971434 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-a6c2d9b8-ca79-46d8-bde2-c6619fec5a7b tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:38:11.972216 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-a6c2d9b8-ca79-46d8-bde2-c6619fec5a7b tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:38:11.973235 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-a6c2d9b8-ca79-46d8-bde2-c6619fec5a7b tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:38:12.118175 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-a6c2d9b8-ca79-46d8-bde2-c6619fec5a7b tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883da006d3f4aec8805c74cf5ffae86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1222038740244f69a977fe658d9bfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:38:12.127679 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-a6c2d9b8-ca79-46d8-bde2-c6619fec5a7b tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "GET /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1" status: 200 len: 1713 microversion: 2.1 time: 0.169405 May 19 13:38:12.138631 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 377/740] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:38:11 2022] GET /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1 => generated 1713 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:38:12.446712 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-97d5e6c8-3913-488d-9926-f6422fb6e296 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:38:12.447331 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-97d5e6c8-3913-488d-9926-f6422fb6e296 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 8ea882c7-9191-4712-91eb-a810e49b9e52] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:38:12.454404 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-97d5e6c8-3913-488d-9926-f6422fb6e296 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:38:12.454858 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-97d5e6c8-3913-488d-9926-f6422fb6e296 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:38:12.455676 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-97d5e6c8-3913-488d-9926-f6422fb6e296 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:38:12.456109 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-97d5e6c8-3913-488d-9926-f6422fb6e296 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:38:12.470437 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.wsgi [None req-97d5e6c8-3913-488d-9926-f6422fb6e296 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] HTTP exception thrown: Instance 8ea882c7-9191-4712-91eb-a810e49b9e52 could not be found. May 19 13:38:12.472365 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-97d5e6c8-3913-488d-9926-f6422fb6e296 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Request method failure captured: May 19 13:38:12.472365 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: request: GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52 HTTP/1.1 May 19 13:38:12.472365 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Accept: application/json May 19 13:38:12.472365 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Accept-Encoding: identity May 19 13:38:12.472365 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Connection: close May 19 13:38:12.472365 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Content-Length: 0 May 19 13:38:12.472365 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Content-Type: application/json May 19 13:38:12.472365 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Host: 10.222.0.24 May 19 13:38:12.472365 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Openstack-System-Scope: None May 19 13:38:12.472365 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: User-Agent: python-urllib3/1.26.9 May 19 13:38:12.472365 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Auth-Token: gAAAAABihkauRwg9SZEVw8gMHHhviMqezzbqwi1XD-02SuOQeJ9H4KRkjWE4j7V6GJW7YEwT2tOV0hmurH7qs_Ror_AWRGpqgWKh-NLVf798ZxYTjf97Zcrj1RBWWF336W5I9d_IzMxCCYaUy4ClKqFGwyR_G6Sj2cN27XBLguIHeRUJfQI8In4 May 19 13:38:12.472365 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Domain-Id: None May 19 13:38:12.472365 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Domain-Name: None May 19 13:38:12.472365 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Identity-Status: Confirmed May 19 13:38:12.472365 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Is-Admin-Project: True May 19 13:38:12.472365 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Openstack-Nova-Api-Version: 2.20 May 19 13:38:12.472365 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Domain-Id: default May 19 13:38:12.472365 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Domain-Name: Default May 19 13:38:12.472365 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Id: 959c5c84bd724d2688f435b15b41f1c8 May 19 13:38:12.472365 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-939349313 May 19 13:38:12.472365 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Role: reader,member May 19 13:38:12.472365 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Roles: reader,member May 19 13:38:12.474060 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/959c5c84bd724d2688f435b15b41f1c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/959c5c84bd724d2688f435b15b41f1c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_959c5c84bd724d2688f435b15b41f1c8", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/959c5c84bd724d2688f435b15b41f1c8"}]}] May 19 13:38:12.474060 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant: tempest-AttachVolumeShelveTestJSON-939349313 May 19 13:38:12.474060 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant-Id: 959c5c84bd724d2688f435b15b41f1c8 May 19 13:38:12.474060 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-939349313 May 19 13:38:12.474060 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User: tempest-AttachVolumeShelveTestJSON-939349313-project May 19 13:38:12.474060 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Domain-Id: default May 19 13:38:12.474060 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Domain-Name: Default May 19 13:38:12.474060 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Id: 14da69798e344e70ba64bf8187523e45 May 19 13:38:12.474060 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Name: tempest-AttachVolumeShelveTestJSON-939349313-project May 19 13:38:12.474060 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: method: > May 19 13:38:12.474060 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: exception: Instance 8ea882c7-9191-4712-91eb-a810e49b9e52 could not be found. May 19 13:38:12.474060 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: action_args: {'id': '8ea882c7-9191-4712-91eb-a810e49b9e52'} May 19 13:38:12.474889 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:38:12.474889 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:38:12.474889 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 13:38:12.474889 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 13:38:12.474889 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 13:38:12.474889 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 13:38:12.474889 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 13:38:12.474889 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 13:38:12.474889 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 13:38:12.474889 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 13:38:12.474889 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ea882c7-9191-4712-91eb-a810e49b9e52 could not be found. May 19 13:38:12.474889 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:38:12.474889 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:38:12.474889 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:38:12.474889 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:38:12.474889 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:38:12.474889 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:38:12.474889 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:38:12.474889 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:38:12.474889 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:38:12.476207 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:38:12.476207 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 13:38:12.476207 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 13:38:12.476207 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 13:38:12.476207 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 13:38:12.476207 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 13:38:12.476207 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 13:38:12.476207 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ea882c7-9191-4712-91eb-a810e49b9e52 could not be found. May 19 13:38:12.476207 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:38:12.476207 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:38:12.476207 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:38:12.476207 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:38:12.476207 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:38:12.476207 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:38:12.476207 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:38:12.476207 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:38:12.476207 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ea882c7-9191-4712-91eb-a810e49b9e52 could not be found. May 19 13:38:12.476207 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:38:12.477340 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-97d5e6c8-3913-488d-9926-f6422fb6e296 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Returning 404 to user: Instance 8ea882c7-9191-4712-91eb-a810e49b9e52 could not be found. {{(pid=120472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:38:12.477340 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-97d5e6c8-3913-488d-9926-f6422fb6e296 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52" status: 404 len: 111 microversion: 2.20 time: 0.030980 May 19 13:38:12.477340 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 364/741] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:38:12 2022] GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 13:38:12.482800 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-c0940fac-6c48-4895-a72c-bc54d85fb9ca tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '.version_select at 0x7f7c2a5415e0>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:38:12.502762 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-c0940fac-6c48-4895-a72c-bc54d85fb9ca tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-400685449" status: 204 len: 0 microversion: 2.20 time: 0.023921 May 19 13:38:12.503400 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 378/742] 10.222.0.24 () {60 vars in 1258 bytes} [Thu May 19 13:38:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-400685449 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 19 13:38:14.275070 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-dc4c230f-010d-4c2e-a2d6-1efe87c17967 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:38:14.275567 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-dc4c230f-010d-4c2e-a2d6-1efe87c17967 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 8ea882c7-9191-4712-91eb-a810e49b9e52] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:38:14.283215 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-dc4c230f-010d-4c2e-a2d6-1efe87c17967 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:38:14.283695 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-dc4c230f-010d-4c2e-a2d6-1efe87c17967 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:38:14.284464 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-dc4c230f-010d-4c2e-a2d6-1efe87c17967 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:38:14.284897 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-dc4c230f-010d-4c2e-a2d6-1efe87c17967 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:38:14.299722 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.wsgi [None req-dc4c230f-010d-4c2e-a2d6-1efe87c17967 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] HTTP exception thrown: Instance 8ea882c7-9191-4712-91eb-a810e49b9e52 could not be found. May 19 13:38:14.301270 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-dc4c230f-010d-4c2e-a2d6-1efe87c17967 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Request method failure captured: May 19 13:38:14.301270 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: request: DELETE /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52 HTTP/1.1 May 19 13:38:14.301270 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Accept: application/json May 19 13:38:14.301270 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Accept-Encoding: identity May 19 13:38:14.301270 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Connection: close May 19 13:38:14.301270 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Content-Length: 0 May 19 13:38:14.301270 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Content-Type: application/json May 19 13:38:14.301270 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Host: 10.222.0.24 May 19 13:38:14.301270 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Openstack-System-Scope: None May 19 13:38:14.301270 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: User-Agent: python-urllib3/1.26.9 May 19 13:38:14.301270 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Auth-Token: gAAAAABihkauRwg9SZEVw8gMHHhviMqezzbqwi1XD-02SuOQeJ9H4KRkjWE4j7V6GJW7YEwT2tOV0hmurH7qs_Ror_AWRGpqgWKh-NLVf798ZxYTjf97Zcrj1RBWWF336W5I9d_IzMxCCYaUy4ClKqFGwyR_G6Sj2cN27XBLguIHeRUJfQI8In4 May 19 13:38:14.301270 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Domain-Id: None May 19 13:38:14.301270 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Domain-Name: None May 19 13:38:14.301270 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Identity-Status: Confirmed May 19 13:38:14.301270 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Is-Admin-Project: True May 19 13:38:14.301270 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Openstack-Nova-Api-Version: 2.20 May 19 13:38:14.301270 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Domain-Id: default May 19 13:38:14.301270 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Domain-Name: Default May 19 13:38:14.301270 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Id: 959c5c84bd724d2688f435b15b41f1c8 May 19 13:38:14.301270 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-939349313 May 19 13:38:14.301270 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Role: reader,member May 19 13:38:14.301270 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Roles: reader,member May 19 13:38:14.302944 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/959c5c84bd724d2688f435b15b41f1c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/959c5c84bd724d2688f435b15b41f1c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_959c5c84bd724d2688f435b15b41f1c8", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/959c5c84bd724d2688f435b15b41f1c8"}]}] May 19 13:38:14.302944 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant: tempest-AttachVolumeShelveTestJSON-939349313 May 19 13:38:14.302944 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant-Id: 959c5c84bd724d2688f435b15b41f1c8 May 19 13:38:14.302944 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-939349313 May 19 13:38:14.302944 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User: tempest-AttachVolumeShelveTestJSON-939349313-project May 19 13:38:14.302944 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Domain-Id: default May 19 13:38:14.302944 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Domain-Name: Default May 19 13:38:14.302944 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Id: 14da69798e344e70ba64bf8187523e45 May 19 13:38:14.302944 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Name: tempest-AttachVolumeShelveTestJSON-939349313-project May 19 13:38:14.302944 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: method: > May 19 13:38:14.302944 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: exception: Instance 8ea882c7-9191-4712-91eb-a810e49b9e52 could not be found. May 19 13:38:14.302944 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: action_args: {'id': '8ea882c7-9191-4712-91eb-a810e49b9e52'} May 19 13:38:14.303784 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:38:14.303784 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:38:14.303784 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 13:38:14.303784 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 13:38:14.303784 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 13:38:14.303784 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 13:38:14.303784 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 13:38:14.303784 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 13:38:14.303784 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 13:38:14.303784 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 13:38:14.303784 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ea882c7-9191-4712-91eb-a810e49b9e52 could not be found. May 19 13:38:14.303784 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:38:14.303784 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:38:14.303784 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:38:14.303784 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:38:14.303784 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:38:14.303784 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:38:14.303784 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:38:14.303784 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:38:14.303784 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:38:14.305228 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:38:14.305228 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 13:38:14.305228 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 13:38:14.305228 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 13:38:14.305228 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 13:38:14.305228 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 13:38:14.305228 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 13:38:14.305228 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 13:38:14.305228 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 13:38:14.305228 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ea882c7-9191-4712-91eb-a810e49b9e52 could not be found. May 19 13:38:14.305228 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:38:14.305228 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:38:14.305228 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:38:14.305228 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:38:14.305228 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:38:14.305228 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:38:14.305228 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:38:14.305228 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:38:14.305228 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ea882c7-9191-4712-91eb-a810e49b9e52 could not be found. May 19 13:38:14.305228 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:38:14.306719 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-dc4c230f-010d-4c2e-a2d6-1efe87c17967 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Returning 404 to user: Instance 8ea882c7-9191-4712-91eb-a810e49b9e52 could not be found. {{(pid=120472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:38:14.306719 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-dc4c230f-010d-4c2e-a2d6-1efe87c17967 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "DELETE /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52" status: 404 len: 111 microversion: 2.20 time: 0.031654 May 19 13:38:14.306719 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 365/743] 10.222.0.24 () {60 vars in 1279 bytes} [Thu May 19 13:38:14 2022] DELETE /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 13:38:14.312192 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-8cc97614-49f2-4ffe-8052-ec25ffb3e471 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:38:14.312808 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-8cc97614-49f2-4ffe-8052-ec25ffb3e471 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 8ea882c7-9191-4712-91eb-a810e49b9e52] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:38:14.321740 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-8cc97614-49f2-4ffe-8052-ec25ffb3e471 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:38:14.322191 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-8cc97614-49f2-4ffe-8052-ec25ffb3e471 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:38:14.322978 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-8cc97614-49f2-4ffe-8052-ec25ffb3e471 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:38:14.323400 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-8cc97614-49f2-4ffe-8052-ec25ffb3e471 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:38:14.337350 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.wsgi [None req-8cc97614-49f2-4ffe-8052-ec25ffb3e471 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] HTTP exception thrown: Instance 8ea882c7-9191-4712-91eb-a810e49b9e52 could not be found. May 19 13:38:14.339026 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-8cc97614-49f2-4ffe-8052-ec25ffb3e471 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Request method failure captured: May 19 13:38:14.339026 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: request: GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52 HTTP/1.1 May 19 13:38:14.339026 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Accept: application/json May 19 13:38:14.339026 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Accept-Encoding: identity May 19 13:38:14.339026 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Connection: close May 19 13:38:14.339026 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Content-Length: 0 May 19 13:38:14.339026 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Content-Type: application/json May 19 13:38:14.339026 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Host: 10.222.0.24 May 19 13:38:14.339026 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Openstack-System-Scope: None May 19 13:38:14.339026 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: User-Agent: python-urllib3/1.26.9 May 19 13:38:14.339026 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Auth-Token: gAAAAABihkauRwg9SZEVw8gMHHhviMqezzbqwi1XD-02SuOQeJ9H4KRkjWE4j7V6GJW7YEwT2tOV0hmurH7qs_Ror_AWRGpqgWKh-NLVf798ZxYTjf97Zcrj1RBWWF336W5I9d_IzMxCCYaUy4ClKqFGwyR_G6Sj2cN27XBLguIHeRUJfQI8In4 May 19 13:38:14.339026 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Domain-Id: None May 19 13:38:14.339026 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Domain-Name: None May 19 13:38:14.339026 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Identity-Status: Confirmed May 19 13:38:14.339026 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Is-Admin-Project: True May 19 13:38:14.339026 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Openstack-Nova-Api-Version: 2.20 May 19 13:38:14.339026 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Domain-Id: default May 19 13:38:14.339026 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Domain-Name: Default May 19 13:38:14.339026 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Id: 959c5c84bd724d2688f435b15b41f1c8 May 19 13:38:14.339026 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-939349313 May 19 13:38:14.339026 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Role: reader,member May 19 13:38:14.339026 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Roles: reader,member May 19 13:38:14.340708 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/959c5c84bd724d2688f435b15b41f1c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/959c5c84bd724d2688f435b15b41f1c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_959c5c84bd724d2688f435b15b41f1c8", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/959c5c84bd724d2688f435b15b41f1c8"}]}] May 19 13:38:14.340708 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Tenant: tempest-AttachVolumeShelveTestJSON-939349313 May 19 13:38:14.340708 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Tenant-Id: 959c5c84bd724d2688f435b15b41f1c8 May 19 13:38:14.340708 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-939349313 May 19 13:38:14.340708 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User: tempest-AttachVolumeShelveTestJSON-939349313-project May 19 13:38:14.340708 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Domain-Id: default May 19 13:38:14.340708 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Domain-Name: Default May 19 13:38:14.340708 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Id: 14da69798e344e70ba64bf8187523e45 May 19 13:38:14.340708 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Name: tempest-AttachVolumeShelveTestJSON-939349313-project May 19 13:38:14.340708 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: method: > May 19 13:38:14.340708 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: exception: Instance 8ea882c7-9191-4712-91eb-a810e49b9e52 could not be found. May 19 13:38:14.340708 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: action_args: {'id': '8ea882c7-9191-4712-91eb-a810e49b9e52'} May 19 13:38:14.341489 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:38:14.341489 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:38:14.341489 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 13:38:14.341489 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 13:38:14.341489 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 13:38:14.341489 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 13:38:14.341489 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 13:38:14.341489 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 13:38:14.341489 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 13:38:14.341489 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 13:38:14.341489 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ea882c7-9191-4712-91eb-a810e49b9e52 could not be found. May 19 13:38:14.341489 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:38:14.341489 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:38:14.341489 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:38:14.341489 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:38:14.341489 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:38:14.341489 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:38:14.341489 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:38:14.341489 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:38:14.341489 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:38:14.342709 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:38:14.342709 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 13:38:14.342709 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 13:38:14.342709 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 13:38:14.342709 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 13:38:14.342709 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 13:38:14.342709 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 13:38:14.342709 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ea882c7-9191-4712-91eb-a810e49b9e52 could not be found. May 19 13:38:14.342709 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:38:14.342709 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:38:14.342709 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:38:14.342709 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:38:14.342709 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:38:14.342709 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:38:14.342709 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:38:14.342709 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:38:14.342709 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ea882c7-9191-4712-91eb-a810e49b9e52 could not be found. May 19 13:38:14.342709 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:38:14.343779 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-8cc97614-49f2-4ffe-8052-ec25ffb3e471 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Returning 404 to user: Instance 8ea882c7-9191-4712-91eb-a810e49b9e52 could not be found. {{(pid=120471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:38:14.343779 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-8cc97614-49f2-4ffe-8052-ec25ffb3e471 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52" status: 404 len: 111 microversion: 2.20 time: 0.033017 May 19 13:38:14.343779 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 379/744] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:38:14 2022] GET /compute/v2.1/servers/8ea882c7-9191-4712-91eb-a810e49b9e52 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 13:38:15.497640 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-7c472c89-1f9f-4120-a5bf-18ae22d03037 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:38:15.498285 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-7c472c89-1f9f-4120-a5bf-18ae22d03037 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:38:15.505698 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-7c472c89-1f9f-4120-a5bf-18ae22d03037 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:38:15.506149 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-7c472c89-1f9f-4120-a5bf-18ae22d03037 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:38:15.506909 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-7c472c89-1f9f-4120-a5bf-18ae22d03037 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:38:15.507344 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-7c472c89-1f9f-4120-a5bf-18ae22d03037 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:38:15.522200 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.wsgi [None req-7c472c89-1f9f-4120-a5bf-18ae22d03037 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] HTTP exception thrown: Instance 323322ec-2e2e-424b-a411-8a34069bcf10 could not be found. May 19 13:38:15.523675 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-7c472c89-1f9f-4120-a5bf-18ae22d03037 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Request method failure captured: May 19 13:38:15.523675 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: request: DELETE /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 HTTP/1.1 May 19 13:38:15.523675 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Accept: application/json May 19 13:38:15.523675 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Accept-Encoding: identity May 19 13:38:15.523675 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Connection: close May 19 13:38:15.523675 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Content-Length: 0 May 19 13:38:15.523675 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Content-Type: application/json May 19 13:38:15.523675 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Host: 10.222.0.24 May 19 13:38:15.523675 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Openstack-System-Scope: None May 19 13:38:15.523675 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: User-Agent: python-urllib3/1.26.9 May 19 13:38:15.523675 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Auth-Token: gAAAAABihkauRwg9SZEVw8gMHHhviMqezzbqwi1XD-02SuOQeJ9H4KRkjWE4j7V6GJW7YEwT2tOV0hmurH7qs_Ror_AWRGpqgWKh-NLVf798ZxYTjf97Zcrj1RBWWF336W5I9d_IzMxCCYaUy4ClKqFGwyR_G6Sj2cN27XBLguIHeRUJfQI8In4 May 19 13:38:15.523675 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Domain-Id: None May 19 13:38:15.523675 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Domain-Name: None May 19 13:38:15.523675 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Identity-Status: Confirmed May 19 13:38:15.523675 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Is-Admin-Project: True May 19 13:38:15.523675 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Openstack-Nova-Api-Version: 2.20 May 19 13:38:15.523675 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Domain-Id: default May 19 13:38:15.523675 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Domain-Name: Default May 19 13:38:15.523675 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Id: 959c5c84bd724d2688f435b15b41f1c8 May 19 13:38:15.523675 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-939349313 May 19 13:38:15.523675 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Role: reader,member May 19 13:38:15.523675 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Roles: reader,member May 19 13:38:15.525134 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/959c5c84bd724d2688f435b15b41f1c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/959c5c84bd724d2688f435b15b41f1c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_959c5c84bd724d2688f435b15b41f1c8", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/959c5c84bd724d2688f435b15b41f1c8"}]}] May 19 13:38:15.525134 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant: tempest-AttachVolumeShelveTestJSON-939349313 May 19 13:38:15.525134 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant-Id: 959c5c84bd724d2688f435b15b41f1c8 May 19 13:38:15.525134 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-939349313 May 19 13:38:15.525134 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User: tempest-AttachVolumeShelveTestJSON-939349313-project May 19 13:38:15.525134 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Domain-Id: default May 19 13:38:15.525134 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Domain-Name: Default May 19 13:38:15.525134 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Id: 14da69798e344e70ba64bf8187523e45 May 19 13:38:15.525134 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Name: tempest-AttachVolumeShelveTestJSON-939349313-project May 19 13:38:15.525134 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: method: > May 19 13:38:15.525134 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: exception: Instance 323322ec-2e2e-424b-a411-8a34069bcf10 could not be found. May 19 13:38:15.525134 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: action_args: {'id': '323322ec-2e2e-424b-a411-8a34069bcf10'} May 19 13:38:15.525925 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:38:15.525925 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:38:15.525925 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 13:38:15.525925 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 13:38:15.525925 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 13:38:15.525925 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 13:38:15.525925 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 13:38:15.525925 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 13:38:15.525925 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 13:38:15.525925 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 13:38:15.525925 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 323322ec-2e2e-424b-a411-8a34069bcf10 could not be found. May 19 13:38:15.525925 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:38:15.525925 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:38:15.525925 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:38:15.525925 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:38:15.525925 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:38:15.525925 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:38:15.525925 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:38:15.525925 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:38:15.525925 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:38:15.527291 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:38:15.527291 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 13:38:15.527291 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 13:38:15.527291 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 13:38:15.527291 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 13:38:15.527291 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 13:38:15.527291 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 13:38:15.527291 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 13:38:15.527291 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 13:38:15.527291 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 323322ec-2e2e-424b-a411-8a34069bcf10 could not be found. May 19 13:38:15.527291 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:38:15.527291 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:38:15.527291 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:38:15.527291 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:38:15.527291 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:38:15.527291 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:38:15.527291 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:38:15.527291 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:38:15.527291 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 323322ec-2e2e-424b-a411-8a34069bcf10 could not be found. May 19 13:38:15.527291 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:38:15.528825 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-7c472c89-1f9f-4120-a5bf-18ae22d03037 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Returning 404 to user: Instance 323322ec-2e2e-424b-a411-8a34069bcf10 could not be found. {{(pid=120472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:38:15.528825 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-7c472c89-1f9f-4120-a5bf-18ae22d03037 tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "DELETE /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 404 len: 111 microversion: 2.20 time: 0.032628 May 19 13:38:15.528825 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 366/745] 10.222.0.24 () {60 vars in 1279 bytes} [Thu May 19 13:38:15 2022] DELETE /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 13:38:15.533989 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-475efed1-f9bb-40e8-a3e5-1e08e1c0e2ba tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:38:15.534622 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-475efed1-f9bb-40e8-a3e5-1e08e1c0e2ba tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] [instance: 323322ec-2e2e-424b-a411-8a34069bcf10] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:38:15.541251 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-475efed1-f9bb-40e8-a3e5-1e08e1c0e2ba tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:38:15.541747 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-475efed1-f9bb-40e8-a3e5-1e08e1c0e2ba tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:38:15.542499 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-475efed1-f9bb-40e8-a3e5-1e08e1c0e2ba tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:38:15.542929 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-475efed1-f9bb-40e8-a3e5-1e08e1c0e2ba tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:38:15.556616 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.wsgi [None req-475efed1-f9bb-40e8-a3e5-1e08e1c0e2ba tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] HTTP exception thrown: Instance 323322ec-2e2e-424b-a411-8a34069bcf10 could not be found. May 19 13:38:15.558155 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-475efed1-f9bb-40e8-a3e5-1e08e1c0e2ba tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Request method failure captured: May 19 13:38:15.558155 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: request: GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 HTTP/1.1 May 19 13:38:15.558155 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Accept: application/json May 19 13:38:15.558155 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Accept-Encoding: identity May 19 13:38:15.558155 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Connection: close May 19 13:38:15.558155 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Content-Length: 0 May 19 13:38:15.558155 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Content-Type: application/json May 19 13:38:15.558155 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Host: 10.222.0.24 May 19 13:38:15.558155 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Openstack-System-Scope: None May 19 13:38:15.558155 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: User-Agent: python-urllib3/1.26.9 May 19 13:38:15.558155 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Auth-Token: gAAAAABihkauRwg9SZEVw8gMHHhviMqezzbqwi1XD-02SuOQeJ9H4KRkjWE4j7V6GJW7YEwT2tOV0hmurH7qs_Ror_AWRGpqgWKh-NLVf798ZxYTjf97Zcrj1RBWWF336W5I9d_IzMxCCYaUy4ClKqFGwyR_G6Sj2cN27XBLguIHeRUJfQI8In4 May 19 13:38:15.558155 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Domain-Id: None May 19 13:38:15.558155 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Domain-Name: None May 19 13:38:15.558155 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Identity-Status: Confirmed May 19 13:38:15.558155 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Is-Admin-Project: True May 19 13:38:15.558155 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Openstack-Nova-Api-Version: 2.20 May 19 13:38:15.558155 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Domain-Id: default May 19 13:38:15.558155 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Domain-Name: Default May 19 13:38:15.558155 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Id: 959c5c84bd724d2688f435b15b41f1c8 May 19 13:38:15.558155 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-939349313 May 19 13:38:15.558155 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Role: reader,member May 19 13:38:15.558155 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Roles: reader,member May 19 13:38:15.559723 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/959c5c84bd724d2688f435b15b41f1c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/959c5c84bd724d2688f435b15b41f1c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_959c5c84bd724d2688f435b15b41f1c8", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/959c5c84bd724d2688f435b15b41f1c8"}]}] May 19 13:38:15.559723 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Tenant: tempest-AttachVolumeShelveTestJSON-939349313 May 19 13:38:15.559723 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Tenant-Id: 959c5c84bd724d2688f435b15b41f1c8 May 19 13:38:15.559723 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-939349313 May 19 13:38:15.559723 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User: tempest-AttachVolumeShelveTestJSON-939349313-project May 19 13:38:15.559723 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Domain-Id: default May 19 13:38:15.559723 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Domain-Name: Default May 19 13:38:15.559723 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Id: 14da69798e344e70ba64bf8187523e45 May 19 13:38:15.559723 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Name: tempest-AttachVolumeShelveTestJSON-939349313-project May 19 13:38:15.559723 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: method: > May 19 13:38:15.559723 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: exception: Instance 323322ec-2e2e-424b-a411-8a34069bcf10 could not be found. May 19 13:38:15.559723 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: action_args: {'id': '323322ec-2e2e-424b-a411-8a34069bcf10'} May 19 13:38:15.560860 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:38:15.560860 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:38:15.560860 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 13:38:15.560860 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 13:38:15.560860 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 13:38:15.560860 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 13:38:15.560860 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 13:38:15.560860 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 13:38:15.560860 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 13:38:15.560860 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 13:38:15.560860 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 323322ec-2e2e-424b-a411-8a34069bcf10 could not be found. May 19 13:38:15.560860 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:38:15.560860 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:38:15.560860 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:38:15.560860 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:38:15.560860 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:38:15.560860 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:38:15.560860 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:38:15.560860 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:38:15.560860 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:38:15.562756 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:38:15.562756 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 13:38:15.562756 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 13:38:15.562756 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 13:38:15.562756 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 13:38:15.562756 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 13:38:15.562756 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 13:38:15.562756 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 323322ec-2e2e-424b-a411-8a34069bcf10 could not be found. May 19 13:38:15.562756 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:38:15.562756 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:38:15.562756 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:38:15.562756 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:38:15.562756 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:38:15.562756 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:38:15.562756 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:38:15.562756 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:38:15.562756 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 323322ec-2e2e-424b-a411-8a34069bcf10 could not be found. May 19 13:38:15.562756 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:38:15.565836 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-475efed1-f9bb-40e8-a3e5-1e08e1c0e2ba tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] Returning 404 to user: Instance 323322ec-2e2e-424b-a411-8a34069bcf10 could not be found. {{(pid=120471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:38:15.565836 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-475efed1-f9bb-40e8-a3e5-1e08e1c0e2ba tempest-AttachVolumeShelveTestJSON-939349313 tempest-AttachVolumeShelveTestJSON-939349313-project] 10.222.0.24 "GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10" status: 404 len: 111 microversion: 2.20 time: 0.029769 May 19 13:38:15.565836 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 380/746] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 13:38:15 2022] GET /compute/v2.1/servers/323322ec-2e2e-424b-a411-8a34069bcf10 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 13:38:47.172254 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-563c3d43-f42a-421a-abd3-cc8ebe227a56 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:38:47.172863 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-563c3d43-f42a-421a-abd3-cc8ebe227a56 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [instance: 5b705092-099b-444c-81cf-ecfacd701ac1] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:38:47.175253 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:38:47.175897 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:38:47.182251 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-563c3d43-f42a-421a-abd3-cc8ebe227a56 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:38:47.182694 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-563c3d43-f42a-421a-abd3-cc8ebe227a56 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:38:47.183519 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-563c3d43-f42a-421a-abd3-cc8ebe227a56 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:38:47.183949 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-563c3d43-f42a-421a-abd3-cc8ebe227a56 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:38:47.282051 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.objects.instance [None req-563c3d43-f42a-421a-abd3-cc8ebe227a56 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lazy-loading 'services' on Instance uuid 5b705092-099b-444c-81cf-ecfacd701ac1 {{(pid=120472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 13:38:47.375440 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-563c3d43-f42a-421a-abd3-cc8ebe227a56 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "DELETE /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1/os-volume_attachments/eae6ee9c-7647-49cc-aac8-7d3f9b880948" status: 202 len: 0 microversion: 2.1 time: 0.207405 May 19 13:38:47.376061 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 367/747] 10.222.0.24 () {58 vars in 1415 bytes} [Thu May 19 13:38:47 2022] DELETE /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1/os-volume_attachments/eae6ee9c-7647-49cc-aac8-7d3f9b880948 => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 13:38:48.504148 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-4c81dd54-f1f8-415a-8b97-a8cbe9d8ca9b tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:38:48.506780 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_api:SELECT=29,nova_api:DELETE=1 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:38:48.507855 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:38:48.518160 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-4c81dd54-f1f8-415a-8b97-a8cbe9d8ca9b tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:38:48.518608 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-4c81dd54-f1f8-415a-8b97-a8cbe9d8ca9b tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:38:48.542939 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-4c81dd54-f1f8-415a-8b97-a8cbe9d8ca9b tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [instance: 5b705092-099b-444c-81cf-ecfacd701ac1] Going to try to stop instance {{(pid=120471) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 19 13:38:48.587871 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-4c81dd54-f1f8-415a-8b97-a8cbe9d8ca9b tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "POST /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1/action" status: 202 len: 0 microversion: 2.1 time: 0.087576 May 19 13:38:48.588627 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 381/748] 10.222.0.24 () {60 vars in 1277 bytes} [Thu May 19 13:38:48 2022] POST /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 13:38:48.598275 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-a2d22efd-8927-4516-b5bf-c0454fd03662 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:38:48.599083 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-a2d22efd-8927-4516-b5bf-c0454fd03662 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [instance: 5b705092-099b-444c-81cf-ecfacd701ac1] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:38:48.606009 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-a2d22efd-8927-4516-b5bf-c0454fd03662 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:38:48.606426 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-a2d22efd-8927-4516-b5bf-c0454fd03662 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:38:48.607324 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-a2d22efd-8927-4516-b5bf-c0454fd03662 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:38:48.607774 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-a2d22efd-8927-4516-b5bf-c0454fd03662 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:38:48.746834 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-a2d22efd-8927-4516-b5bf-c0454fd03662 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883da006d3f4aec8805c74cf5ffae86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1222038740244f69a977fe658d9bfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:38:48.754840 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-a2d22efd-8927-4516-b5bf-c0454fd03662 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "GET /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1" status: 200 len: 1677 microversion: 2.1 time: 0.161681 May 19 13:38:48.755406 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 368/749] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:38:48 2022] GET /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1 => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:38:49.774058 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-4f8b6ebf-51e4-44fe-9d53-a15cea018496 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:38:49.774858 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-4f8b6ebf-51e4-44fe-9d53-a15cea018496 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [instance: 5b705092-099b-444c-81cf-ecfacd701ac1] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:38:49.781773 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-4f8b6ebf-51e4-44fe-9d53-a15cea018496 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:38:49.782264 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-4f8b6ebf-51e4-44fe-9d53-a15cea018496 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:38:49.783027 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-4f8b6ebf-51e4-44fe-9d53-a15cea018496 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:38:49.783460 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-4f8b6ebf-51e4-44fe-9d53-a15cea018496 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:38:49.930494 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-4f8b6ebf-51e4-44fe-9d53-a15cea018496 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883da006d3f4aec8805c74cf5ffae86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1222038740244f69a977fe658d9bfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:38:49.939342 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-4f8b6ebf-51e4-44fe-9d53-a15cea018496 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "GET /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1" status: 200 len: 1677 microversion: 2.1 time: 0.170231 May 19 13:38:49.939855 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 382/750] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:38:49 2022] GET /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1 => generated 1677 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:38:50.959634 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-2c04a8de-433b-4412-974a-b4db3a8d0603 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:38:50.960363 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-2c04a8de-433b-4412-974a-b4db3a8d0603 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [instance: 5b705092-099b-444c-81cf-ecfacd701ac1] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:38:50.969158 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-2c04a8de-433b-4412-974a-b4db3a8d0603 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:38:50.969750 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-2c04a8de-433b-4412-974a-b4db3a8d0603 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:38:50.970682 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-2c04a8de-433b-4412-974a-b4db3a8d0603 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:38:50.971211 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-2c04a8de-433b-4412-974a-b4db3a8d0603 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:38:51.112687 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-2c04a8de-433b-4412-974a-b4db3a8d0603 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883da006d3f4aec8805c74cf5ffae86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1222038740244f69a977fe658d9bfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:38:51.126706 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-2c04a8de-433b-4412-974a-b4db3a8d0603 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "GET /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1" status: 200 len: 1677 microversion: 2.1 time: 0.171830 May 19 13:38:51.127518 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 369/751] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:38:50 2022] GET /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1 => generated 1677 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:38:52.147316 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-7823d726-a6d7-4dbd-901e-0c55100a22ff tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:38:52.147870 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-7823d726-a6d7-4dbd-901e-0c55100a22ff tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [instance: 5b705092-099b-444c-81cf-ecfacd701ac1] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:38:52.155130 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-7823d726-a6d7-4dbd-901e-0c55100a22ff tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:38:52.155658 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-7823d726-a6d7-4dbd-901e-0c55100a22ff tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:38:52.156439 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-7823d726-a6d7-4dbd-901e-0c55100a22ff tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:38:52.156868 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-7823d726-a6d7-4dbd-901e-0c55100a22ff tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:38:52.299532 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-7823d726-a6d7-4dbd-901e-0c55100a22ff tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883da006d3f4aec8805c74cf5ffae86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1222038740244f69a977fe658d9bfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:38:52.308571 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-7823d726-a6d7-4dbd-901e-0c55100a22ff tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "GET /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1" status: 200 len: 1677 microversion: 2.1 time: 0.165265 May 19 13:38:52.309134 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 383/752] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:38:52 2022] GET /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1 => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:38:53.327137 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-c456be8c-d6d0-41cc-b418-e036bf6ac9ae tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:38:53.327732 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-c456be8c-d6d0-41cc-b418-e036bf6ac9ae tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [instance: 5b705092-099b-444c-81cf-ecfacd701ac1] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:38:53.334749 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-c456be8c-d6d0-41cc-b418-e036bf6ac9ae tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:38:53.335159 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-c456be8c-d6d0-41cc-b418-e036bf6ac9ae tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:38:53.335960 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-c456be8c-d6d0-41cc-b418-e036bf6ac9ae tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:38:53.336354 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-c456be8c-d6d0-41cc-b418-e036bf6ac9ae tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:38:53.475207 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-c456be8c-d6d0-41cc-b418-e036bf6ac9ae tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883da006d3f4aec8805c74cf5ffae86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1222038740244f69a977fe658d9bfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:38:53.487686 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-c456be8c-d6d0-41cc-b418-e036bf6ac9ae tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "GET /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1" status: 200 len: 1677 microversion: 2.1 time: 0.164446 May 19 13:38:53.488477 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 370/753] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:38:53 2022] GET /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1 => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:38:54.511547 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-52374f56-5c45-4de4-9b1d-119ba4ae2c0a tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:38:54.512527 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-52374f56-5c45-4de4-9b1d-119ba4ae2c0a tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [instance: 5b705092-099b-444c-81cf-ecfacd701ac1] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:38:54.523545 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-52374f56-5c45-4de4-9b1d-119ba4ae2c0a tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:38:54.524278 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-52374f56-5c45-4de4-9b1d-119ba4ae2c0a tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:38:54.525515 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-52374f56-5c45-4de4-9b1d-119ba4ae2c0a tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:38:54.526286 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-52374f56-5c45-4de4-9b1d-119ba4ae2c0a tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:38:54.654316 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-52374f56-5c45-4de4-9b1d-119ba4ae2c0a tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883da006d3f4aec8805c74cf5ffae86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1222038740244f69a977fe658d9bfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:38:54.661889 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-52374f56-5c45-4de4-9b1d-119ba4ae2c0a tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "GET /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1" status: 200 len: 1677 microversion: 2.1 time: 0.156864 May 19 13:38:54.662469 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 384/754] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:38:54 2022] GET /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:38:55.683373 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-4eb7fd13-dece-4676-b7de-616e925e0f00 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:38:55.684001 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-4eb7fd13-dece-4676-b7de-616e925e0f00 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [instance: 5b705092-099b-444c-81cf-ecfacd701ac1] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:38:55.691708 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-4eb7fd13-dece-4676-b7de-616e925e0f00 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:38:55.692087 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-4eb7fd13-dece-4676-b7de-616e925e0f00 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:38:55.692863 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-4eb7fd13-dece-4676-b7de-616e925e0f00 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:38:55.693323 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-4eb7fd13-dece-4676-b7de-616e925e0f00 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:38:55.824778 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-4eb7fd13-dece-4676-b7de-616e925e0f00 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883da006d3f4aec8805c74cf5ffae86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1222038740244f69a977fe658d9bfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:38:55.832800 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-4eb7fd13-dece-4676-b7de-616e925e0f00 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "GET /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1" status: 200 len: 1677 microversion: 2.1 time: 0.155836 May 19 13:38:55.833334 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 371/755] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:38:55 2022] GET /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:38:56.853374 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-ab40de52-2c32-4e26-a8ba-7236a766170d tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:38:56.853919 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-ab40de52-2c32-4e26-a8ba-7236a766170d tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [instance: 5b705092-099b-444c-81cf-ecfacd701ac1] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:38:56.861015 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-ab40de52-2c32-4e26-a8ba-7236a766170d tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:38:56.861498 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-ab40de52-2c32-4e26-a8ba-7236a766170d tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:38:56.862269 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-ab40de52-2c32-4e26-a8ba-7236a766170d tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:38:56.862721 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-ab40de52-2c32-4e26-a8ba-7236a766170d tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:38:56.997861 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-ab40de52-2c32-4e26-a8ba-7236a766170d tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883da006d3f4aec8805c74cf5ffae86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1222038740244f69a977fe658d9bfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:38:57.005574 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-ab40de52-2c32-4e26-a8ba-7236a766170d tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "GET /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1" status: 200 len: 1677 microversion: 2.1 time: 0.156158 May 19 13:38:57.006143 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 385/756] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:38:56 2022] GET /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:38:58.024552 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-af54cf7a-c7db-4352-84a0-7ae4360a0829 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:38:58.025221 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-af54cf7a-c7db-4352-84a0-7ae4360a0829 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [instance: 5b705092-099b-444c-81cf-ecfacd701ac1] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:38:58.032477 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-af54cf7a-c7db-4352-84a0-7ae4360a0829 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:38:58.032929 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-af54cf7a-c7db-4352-84a0-7ae4360a0829 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:38:58.033720 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-af54cf7a-c7db-4352-84a0-7ae4360a0829 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:38:58.034152 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-af54cf7a-c7db-4352-84a0-7ae4360a0829 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:38:58.179208 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-af54cf7a-c7db-4352-84a0-7ae4360a0829 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883da006d3f4aec8805c74cf5ffae86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1222038740244f69a977fe658d9bfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:38:58.187926 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-af54cf7a-c7db-4352-84a0-7ae4360a0829 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "GET /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1" status: 200 len: 1677 microversion: 2.1 time: 0.168926 May 19 13:38:58.188674 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 372/757] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:38:58 2022] GET /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1 => generated 1677 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:38:59.206423 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-6366d3ae-c0d2-406b-930e-184bce1b8b32 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:38:59.207044 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-6366d3ae-c0d2-406b-930e-184bce1b8b32 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [instance: 5b705092-099b-444c-81cf-ecfacd701ac1] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:38:59.214311 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-6366d3ae-c0d2-406b-930e-184bce1b8b32 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:38:59.214752 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-6366d3ae-c0d2-406b-930e-184bce1b8b32 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:38:59.215692 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-6366d3ae-c0d2-406b-930e-184bce1b8b32 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:38:59.216169 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-6366d3ae-c0d2-406b-930e-184bce1b8b32 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:38:59.355939 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-6366d3ae-c0d2-406b-930e-184bce1b8b32 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883da006d3f4aec8805c74cf5ffae86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1222038740244f69a977fe658d9bfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:38:59.363567 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-6366d3ae-c0d2-406b-930e-184bce1b8b32 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "GET /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1" status: 200 len: 1654 microversion: 2.1 time: 0.161304 May 19 13:38:59.364126 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 386/758] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:38:59 2022] GET /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1 => generated 1654 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:38:59.380064 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-8e9ce1eb-fa2b-4574-b7d5-98596a88d789 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:38:59.386758 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-8e9ce1eb-fa2b-4574-b7d5-98596a88d789 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:38:59.387308 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-8e9ce1eb-fa2b-4574-b7d5-98596a88d789 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:38:59.452805 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-8e9ce1eb-fa2b-4574-b7d5-98596a88d789 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [instance: 5b705092-099b-444c-81cf-ecfacd701ac1] Going to try to start instance {{(pid=120472) start /opt/stack/nova/nova/compute/api.py:2730}} May 19 13:38:59.499103 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-8e9ce1eb-fa2b-4574-b7d5-98596a88d789 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "POST /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1/action" status: 202 len: 0 microversion: 2.1 time: 0.122853 May 19 13:38:59.499699 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 373/759] 10.222.0.24 () {60 vars in 1277 bytes} [Thu May 19 13:38:59 2022] POST /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 13:38:59.507894 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-e3e3390b-17fc-4df8-978a-96ef422df4fe tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:38:59.508498 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-e3e3390b-17fc-4df8-978a-96ef422df4fe tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [instance: 5b705092-099b-444c-81cf-ecfacd701ac1] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:38:59.515153 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-e3e3390b-17fc-4df8-978a-96ef422df4fe tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:38:59.515153 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-e3e3390b-17fc-4df8-978a-96ef422df4fe tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:38:59.515884 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-e3e3390b-17fc-4df8-978a-96ef422df4fe tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:38:59.516314 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-e3e3390b-17fc-4df8-978a-96ef422df4fe tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:38:59.664595 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-e3e3390b-17fc-4df8-978a-96ef422df4fe tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883da006d3f4aec8805c74cf5ffae86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1222038740244f69a977fe658d9bfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:38:59.672554 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-e3e3390b-17fc-4df8-978a-96ef422df4fe tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "GET /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1" status: 200 len: 1663 microversion: 2.1 time: 0.168409 May 19 13:38:59.673150 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 387/760] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:38:59 2022] GET /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1 => generated 1663 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:39:00.697533 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-1d98ae30-01f2-4773-967b-dec07472a8f5 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:39:00.698208 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-1d98ae30-01f2-4773-967b-dec07472a8f5 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [instance: 5b705092-099b-444c-81cf-ecfacd701ac1] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:39:00.705713 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-1d98ae30-01f2-4773-967b-dec07472a8f5 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:39:00.706161 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-1d98ae30-01f2-4773-967b-dec07472a8f5 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:39:00.706938 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-1d98ae30-01f2-4773-967b-dec07472a8f5 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:39:00.707365 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-1d98ae30-01f2-4773-967b-dec07472a8f5 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:39:00.868854 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-1d98ae30-01f2-4773-967b-dec07472a8f5 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883da006d3f4aec8805c74cf5ffae86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1222038740244f69a977fe658d9bfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:39:00.876845 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-1d98ae30-01f2-4773-967b-dec07472a8f5 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "GET /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1" status: 200 len: 1663 microversion: 2.1 time: 0.184535 May 19 13:39:00.877522 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 374/761] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:39:00 2022] GET /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1 => generated 1663 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:39:01.894483 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-6b6259f4-7eca-48f3-ab58-de6ca56f6bf8 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:39:01.895218 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-6b6259f4-7eca-48f3-ab58-de6ca56f6bf8 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [instance: 5b705092-099b-444c-81cf-ecfacd701ac1] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:39:01.901978 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-6b6259f4-7eca-48f3-ab58-de6ca56f6bf8 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:39:01.902536 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-6b6259f4-7eca-48f3-ab58-de6ca56f6bf8 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:39:01.903311 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-6b6259f4-7eca-48f3-ab58-de6ca56f6bf8 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:39:01.903907 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-6b6259f4-7eca-48f3-ab58-de6ca56f6bf8 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:39:02.043489 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-6b6259f4-7eca-48f3-ab58-de6ca56f6bf8 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883da006d3f4aec8805c74cf5ffae86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1222038740244f69a977fe658d9bfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:39:02.051528 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-6b6259f4-7eca-48f3-ab58-de6ca56f6bf8 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "GET /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1" status: 200 len: 1667 microversion: 2.1 time: 0.160899 May 19 13:39:02.052212 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 388/762] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:39:01 2022] GET /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1 => generated 1667 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:39:06.836381 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-94289580-5c66-4226-8296-d1cab6e2206d tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:39:06.836922 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-94289580-5c66-4226-8296-d1cab6e2206d tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] [instance: 9ffb3760-1c38-48de-abb9-ac0e14389d8f] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:39:06.843677 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-94289580-5c66-4226-8296-d1cab6e2206d tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:39:06.844130 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-94289580-5c66-4226-8296-d1cab6e2206d tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:39:06.844892 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-94289580-5c66-4226-8296-d1cab6e2206d tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:39:06.845324 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-94289580-5c66-4226-8296-d1cab6e2206d tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:39:06.872616 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-94289580-5c66-4226-8296-d1cab6e2206d tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] [instance: 9ffb3760-1c38-48de-abb9-ac0e14389d8f] Going to try to terminate instance {{(pid=120472) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 13:39:06.959840 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-94289580-5c66-4226-8296-d1cab6e2206d tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] 10.222.0.24 "DELETE /compute/v2.1/servers/9ffb3760-1c38-48de-abb9-ac0e14389d8f" status: 204 len: 0 microversion: 2.1 time: 0.127153 May 19 13:39:06.960824 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 375/763] 10.222.0.24 () {58 vars in 1238 bytes} [Thu May 19 13:39:06 2022] DELETE /compute/v2.1/servers/9ffb3760-1c38-48de-abb9-ac0e14389d8f => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 13:39:06.969563 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-4de4cd72-a1af-40d0-b61a-3157ef488a05 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:39:06.970167 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-4de4cd72-a1af-40d0-b61a-3157ef488a05 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] [instance: 9ffb3760-1c38-48de-abb9-ac0e14389d8f] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:39:06.976771 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-4de4cd72-a1af-40d0-b61a-3157ef488a05 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:39:06.977212 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-4de4cd72-a1af-40d0-b61a-3157ef488a05 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:39:06.978006 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-4de4cd72-a1af-40d0-b61a-3157ef488a05 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:39:06.978431 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-4de4cd72-a1af-40d0-b61a-3157ef488a05 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:39:07.115932 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-4de4cd72-a1af-40d0-b61a-3157ef488a05 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0a4b41707d444581ee0aa2296ac0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ad7b921dbc4a8d9e9be0d50385deee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:39:07.123953 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-4de4cd72-a1af-40d0-b61a-3157ef488a05 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] 10.222.0.24 "GET /compute/v2.1/servers/9ffb3760-1c38-48de-abb9-ac0e14389d8f" status: 200 len: 1577 microversion: 2.1 time: 0.158454 May 19 13:39:07.124430 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 389/764] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:39:06 2022] GET /compute/v2.1/servers/9ffb3760-1c38-48de-abb9-ac0e14389d8f => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:39:08.145761 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-d423d4e6-0bdc-4a61-8beb-e2dc69c9f59c tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:39:08.146971 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-d423d4e6-0bdc-4a61-8beb-e2dc69c9f59c tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] [instance: 9ffb3760-1c38-48de-abb9-ac0e14389d8f] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:39:08.158016 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-d423d4e6-0bdc-4a61-8beb-e2dc69c9f59c tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:39:08.158495 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-d423d4e6-0bdc-4a61-8beb-e2dc69c9f59c tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:39:08.159771 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-d423d4e6-0bdc-4a61-8beb-e2dc69c9f59c tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:39:08.160490 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-d423d4e6-0bdc-4a61-8beb-e2dc69c9f59c tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:39:08.314135 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-d423d4e6-0bdc-4a61-8beb-e2dc69c9f59c tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0a4b41707d444581ee0aa2296ac0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ad7b921dbc4a8d9e9be0d50385deee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:39:08.322335 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-d423d4e6-0bdc-4a61-8beb-e2dc69c9f59c tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] 10.222.0.24 "GET /compute/v2.1/servers/9ffb3760-1c38-48de-abb9-ac0e14389d8f" status: 200 len: 1577 microversion: 2.1 time: 0.183645 May 19 13:39:08.322871 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 376/765] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:39:08 2022] GET /compute/v2.1/servers/9ffb3760-1c38-48de-abb9-ac0e14389d8f => generated 1577 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:39:09.342056 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-726a6292-5a93-4045-8845-a4a9681b60ab tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:39:09.343623 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-726a6292-5a93-4045-8845-a4a9681b60ab tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] [instance: 9ffb3760-1c38-48de-abb9-ac0e14389d8f] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:39:09.351522 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-726a6292-5a93-4045-8845-a4a9681b60ab tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:39:09.352046 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-726a6292-5a93-4045-8845-a4a9681b60ab tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:39:09.352742 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-726a6292-5a93-4045-8845-a4a9681b60ab tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:39:09.353203 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-726a6292-5a93-4045-8845-a4a9681b60ab tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:39:09.437819 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-726a6292-5a93-4045-8845-a4a9681b60ab tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0a4b41707d444581ee0aa2296ac0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ad7b921dbc4a8d9e9be0d50385deee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:39:09.446986 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-726a6292-5a93-4045-8845-a4a9681b60ab tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] 10.222.0.24 "GET /compute/v2.1/servers/9ffb3760-1c38-48de-abb9-ac0e14389d8f" status: 200 len: 1509 microversion: 2.1 time: 0.110159 May 19 13:39:09.447736 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 390/766] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:39:09 2022] GET /compute/v2.1/servers/9ffb3760-1c38-48de-abb9-ac0e14389d8f => generated 1509 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:39:09.500636 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [req-17dddec6-3306-4b6e-a90f-01819c247cb0 req-25dba754-eba5-42c0-87e9-34ca18583a16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ffb3760-1c38-48de-abb9-ac0e14389d8f", "name": "network-vif-deleted", "tag": "dc294f75-6a16-4072-8363-f879c3f39838"}]} {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:39:09.513729 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [req-17dddec6-3306-4b6e-a90f-01819c247cb0 req-25dba754-eba5-42c0-87e9-34ca18583a16 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:39:09.514689 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [req-17dddec6-3306-4b6e-a90f-01819c247cb0 req-25dba754-eba5-42c0-87e9-34ca18583a16 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:39:09.530994 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.compute.server_external_events [req-17dddec6-3306-4b6e-a90f-01819c247cb0 req-25dba754-eba5-42c0-87e9-34ca18583a16 service nova] Creating event network-vif-deleted:dc294f75-6a16-4072-8363-f879c3f39838 for instance 9ffb3760-1c38-48de-abb9-ac0e14389d8f on hv-cinder-84112 May 19 13:39:09.537635 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [req-17dddec6-3306-4b6e-a90f-01819c247cb0 req-25dba754-eba5-42c0-87e9-34ca18583a16 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041233 May 19 13:39:09.539071 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 377/767] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:39:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:39:10.465831 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-9b76b14e-1024-4c04-a807-57a6187c6eca tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:39:10.467157 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-9b76b14e-1024-4c04-a807-57a6187c6eca tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] [instance: 9ffb3760-1c38-48de-abb9-ac0e14389d8f] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:39:10.475391 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-9b76b14e-1024-4c04-a807-57a6187c6eca tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:39:10.476047 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-9b76b14e-1024-4c04-a807-57a6187c6eca tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:39:10.477851 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-9b76b14e-1024-4c04-a807-57a6187c6eca tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:39:10.478447 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-9b76b14e-1024-4c04-a807-57a6187c6eca tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:39:10.493527 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.wsgi [None req-9b76b14e-1024-4c04-a807-57a6187c6eca tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] HTTP exception thrown: Instance 9ffb3760-1c38-48de-abb9-ac0e14389d8f could not be found. May 19 13:39:10.495646 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-9b76b14e-1024-4c04-a807-57a6187c6eca tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Request method failure captured: May 19 13:39:10.495646 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: request: GET /compute/v2.1/servers/9ffb3760-1c38-48de-abb9-ac0e14389d8f HTTP/1.1 May 19 13:39:10.495646 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Accept: application/json May 19 13:39:10.495646 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Accept-Encoding: identity May 19 13:39:10.495646 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Connection: close May 19 13:39:10.495646 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Content-Length: 0 May 19 13:39:10.495646 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Content-Type: application/json May 19 13:39:10.495646 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Host: 10.222.0.24 May 19 13:39:10.495646 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Openstack-System-Scope: None May 19 13:39:10.495646 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: User-Agent: python-urllib3/1.26.9 May 19 13:39:10.495646 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Auth-Token: gAAAAABihkfZZi3CO4kgMRQyXdYId70aYnRUeD_PBCoZE9_U-eSRdPDJ8U-K8FIgr4iKsCo_31Ll0TF-QRYIfsMapwxYbX4ntNVtGmD2GqJq7AavkFVumf5rk50QPpfFewjlRyH5ReYCECCj_Fybs53mzU-L1x3JDP2S0BBbSe44_2Eh-84z8Aw May 19 13:39:10.495646 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Domain-Id: None May 19 13:39:10.495646 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Domain-Name: None May 19 13:39:10.495646 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Identity-Status: Confirmed May 19 13:39:10.495646 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Is-Admin-Project: True May 19 13:39:10.495646 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Domain-Id: default May 19 13:39:10.495646 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Domain-Name: Default May 19 13:39:10.495646 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Id: 98ad7b921dbc4a8d9e9be0d50385deee May 19 13:39:10.495646 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Name: tempest-TestVolumeBootPattern-1301025888 May 19 13:39:10.495646 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Role: reader,member May 19 13:39:10.495646 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Roles: reader,member May 19 13:39:10.497314 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/98ad7b921dbc4a8d9e9be0d50385deee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/98ad7b921dbc4a8d9e9be0d50385deee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_98ad7b921dbc4a8d9e9be0d50385deee", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/98ad7b921dbc4a8d9e9be0d50385deee"}]}] May 19 13:39:10.497314 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Tenant: tempest-TestVolumeBootPattern-1301025888 May 19 13:39:10.497314 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Tenant-Id: 98ad7b921dbc4a8d9e9be0d50385deee May 19 13:39:10.497314 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Tenant-Name: tempest-TestVolumeBootPattern-1301025888 May 19 13:39:10.497314 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User: tempest-TestVolumeBootPattern-1301025888-project May 19 13:39:10.497314 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Domain-Id: default May 19 13:39:10.497314 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Domain-Name: Default May 19 13:39:10.497314 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Id: aa0a4b41707d444581ee0aa2296ac0ba May 19 13:39:10.497314 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Name: tempest-TestVolumeBootPattern-1301025888-project May 19 13:39:10.497314 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: method: > May 19 13:39:10.497314 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: exception: Instance 9ffb3760-1c38-48de-abb9-ac0e14389d8f could not be found. May 19 13:39:10.497314 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: action_args: {'id': '9ffb3760-1c38-48de-abb9-ac0e14389d8f'} May 19 13:39:10.498314 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:39:10.498314 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:39:10.498314 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 13:39:10.498314 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 13:39:10.498314 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 13:39:10.498314 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 13:39:10.498314 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 13:39:10.498314 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 13:39:10.498314 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 13:39:10.498314 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 13:39:10.498314 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ffb3760-1c38-48de-abb9-ac0e14389d8f could not be found. May 19 13:39:10.498314 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:39:10.498314 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:39:10.498314 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:39:10.498314 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:39:10.498314 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:39:10.498314 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:39:10.498314 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:39:10.498314 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:39:10.498314 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:39:10.500401 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:39:10.500401 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 13:39:10.500401 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 13:39:10.500401 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 13:39:10.500401 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 13:39:10.500401 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 13:39:10.500401 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 13:39:10.500401 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ffb3760-1c38-48de-abb9-ac0e14389d8f could not be found. May 19 13:39:10.500401 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:39:10.500401 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:39:10.500401 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:39:10.500401 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:39:10.500401 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:39:10.500401 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:39:10.500401 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:39:10.500401 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:39:10.500401 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ffb3760-1c38-48de-abb9-ac0e14389d8f could not be found. May 19 13:39:10.500401 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:39:10.503220 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-9b76b14e-1024-4c04-a807-57a6187c6eca tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Returning 404 to user: Instance 9ffb3760-1c38-48de-abb9-ac0e14389d8f could not be found. {{(pid=120471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:39:10.504411 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-9b76b14e-1024-4c04-a807-57a6187c6eca tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] 10.222.0.24 "GET /compute/v2.1/servers/9ffb3760-1c38-48de-abb9-ac0e14389d8f" status: 404 len: 111 microversion: 2.1 time: 0.043343 May 19 13:39:10.505200 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 391/768] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:39:10 2022] GET /compute/v2.1/servers/9ffb3760-1c38-48de-abb9-ac0e14389d8f => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 13:39:10.614391 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-4e657b41-3fc3-4d5c-87d8-0dbecd064dc1 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-375848971", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1595031897", "security_groups": [{"name": "tempest-secgroup-smoke-1083232826"}], "block_device_mapping_v2": [{"uuid": "b467a66b-b05c-4acb-ba6d-2e7d84aa24dd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "43f56851-7e12-4789-85bf-4f3ea4d4394d"}]}} {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:39:10.729824 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.network.neutron [None req-4e657b41-3fc3-4d5c-87d8-0dbecd064dc1 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] validate_networks() for [('43f56851-7e12-4789-85bf-4f3ea4d4394d', None, None, None, None, None)] {{(pid=120472) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 13:39:11.114892 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.virt.hardware [None req-4e657b41-3fc3-4d5c-87d8-0dbecd064dc1 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Flavor limits 0:0:0 {{(pid=120472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 13:39:11.115311 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.virt.hardware [None req-4e657b41-3fc3-4d5c-87d8-0dbecd064dc1 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Image limits 0:0:0 {{(pid=120472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 13:39:11.115777 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.virt.hardware [None req-4e657b41-3fc3-4d5c-87d8-0dbecd064dc1 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Flavor pref 0:0:0 {{(pid=120472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 13:39:11.116206 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.virt.hardware [None req-4e657b41-3fc3-4d5c-87d8-0dbecd064dc1 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Image pref 0:0:0 {{(pid=120472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 13:39:11.116613 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.virt.hardware [None req-4e657b41-3fc3-4d5c-87d8-0dbecd064dc1 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 13:39:11.129183 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-4e657b41-3fc3-4d5c-87d8-0dbecd064dc1 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:39:11.129679 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-4e657b41-3fc3-4d5c-87d8-0dbecd064dc1 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:39:11.130484 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-4e657b41-3fc3-4d5c-87d8-0dbecd064dc1 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:39:11.130940 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-4e657b41-3fc3-4d5c-87d8-0dbecd064dc1 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:39:11.148129 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.quota [None req-4e657b41-3fc3-4d5c-87d8-0dbecd064dc1 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Getting quotas for project 98ad7b921dbc4a8d9e9be0d50385deee. Resources: {'instances', 'cores', 'ram'} {{(pid=120472) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 13:39:11.152062 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.quota [None req-4e657b41-3fc3-4d5c-87d8-0dbecd064dc1 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Getting quotas for user aa0a4b41707d444581ee0aa2296ac0ba and project 98ad7b921dbc4a8d9e9be0d50385deee. Resources: {'instances', 'cores', 'ram'} {{(pid=120472) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 13:39:11.216591 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-4e657b41-3fc3-4d5c-87d8-0dbecd064dc1 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Going to run 1 instances... {{(pid=120472) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 13:39:11.219205 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-4e657b41-3fc3-4d5c-87d8-0dbecd064dc1 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] [instance: e04724e3-bd2a-49a5-bad8-c9d186bc7211] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b467a66b-b05c-4acb-ba6d-2e7d84aa24dd',volume_size=None,volume_type=None)] {{(pid=120472) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 13:39:11.354087 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-4e657b41-3fc3-4d5c-87d8-0dbecd064dc1 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.744192 May 19 13:39:11.359912 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 378/769] 10.222.0.24 () {60 vars in 1146 bytes} [Thu May 19 13:39:10 2022] POST /compute/v2.1/servers => generated 406 bytes in 746 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 13:39:11.365145 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-937e418d-1f79-4522-b647-b15dcb5826b8 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:39:11.365758 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-937e418d-1f79-4522-b647-b15dcb5826b8 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] [instance: e04724e3-bd2a-49a5-bad8-c9d186bc7211] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:39:11.430215 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-937e418d-1f79-4522-b647-b15dcb5826b8 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0a4b41707d444581ee0aa2296ac0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ad7b921dbc4a8d9e9be0d50385deee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:39:11.439217 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-937e418d-1f79-4522-b647-b15dcb5826b8 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] 10.222.0.24 "GET /compute/v2.1/servers/e04724e3-bd2a-49a5-bad8-c9d186bc7211" status: 200 len: 1094 microversion: 2.1 time: 0.077655 May 19 13:39:11.445635 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 392/770] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:39:11 2022] GET /compute/v2.1/servers/e04724e3-bd2a-49a5-bad8-c9d186bc7211 => generated 1094 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:39:12.460987 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-413b7158-42f5-4a3b-ad7a-68f6fe87c040 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:39:12.461630 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-413b7158-42f5-4a3b-ad7a-68f6fe87c040 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] [instance: e04724e3-bd2a-49a5-bad8-c9d186bc7211] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:39:12.471075 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-413b7158-42f5-4a3b-ad7a-68f6fe87c040 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:39:12.471581 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-413b7158-42f5-4a3b-ad7a-68f6fe87c040 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:39:12.472301 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-413b7158-42f5-4a3b-ad7a-68f6fe87c040 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:39:12.472734 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-413b7158-42f5-4a3b-ad7a-68f6fe87c040 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:39:12.593518 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-413b7158-42f5-4a3b-ad7a-68f6fe87c040 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0a4b41707d444581ee0aa2296ac0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ad7b921dbc4a8d9e9be0d50385deee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:39:12.603899 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-413b7158-42f5-4a3b-ad7a-68f6fe87c040 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] 10.222.0.24 "GET /compute/v2.1/servers/e04724e3-bd2a-49a5-bad8-c9d186bc7211" status: 200 len: 1210 microversion: 2.1 time: 0.147094 May 19 13:39:12.604613 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 379/771] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:39:12 2022] GET /compute/v2.1/servers/e04724e3-bd2a-49a5-bad8-c9d186bc7211 => generated 1210 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:39:13.636852 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-d4379b50-08ae-4e50-9bf0-63ff3b4b19a1 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:39:13.642141 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-d4379b50-08ae-4e50-9bf0-63ff3b4b19a1 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] [instance: e04724e3-bd2a-49a5-bad8-c9d186bc7211] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:39:13.653478 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-d4379b50-08ae-4e50-9bf0-63ff3b4b19a1 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:39:13.654166 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-d4379b50-08ae-4e50-9bf0-63ff3b4b19a1 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:39:13.655228 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-d4379b50-08ae-4e50-9bf0-63ff3b4b19a1 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:39:13.655917 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-d4379b50-08ae-4e50-9bf0-63ff3b4b19a1 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:39:13.812927 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-d4379b50-08ae-4e50-9bf0-63ff3b4b19a1 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0a4b41707d444581ee0aa2296ac0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ad7b921dbc4a8d9e9be0d50385deee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:39:13.824648 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-d4379b50-08ae-4e50-9bf0-63ff3b4b19a1 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] 10.222.0.24 "GET /compute/v2.1/servers/e04724e3-bd2a-49a5-bad8-c9d186bc7211" status: 200 len: 1266 microversion: 2.1 time: 0.204144 May 19 13:39:13.825243 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 393/772] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:39:13 2022] GET /compute/v2.1/servers/e04724e3-bd2a-49a5-bad8-c9d186bc7211 => generated 1266 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:39:14.084800 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [req-ff737a8b-ed6b-4edb-8572-f09482ee9fd5 req-f831804f-44cf-49af-8abf-2c2cf728bbe9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e04724e3-bd2a-49a5-bad8-c9d186bc7211", "tag": "c0ab3804-fc2a-4ea2-b784-19b69d342b58"}]} {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:39:14.095130 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [req-ff737a8b-ed6b-4edb-8572-f09482ee9fd5 req-f831804f-44cf-49af-8abf-2c2cf728bbe9 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:39:14.095500 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [req-ff737a8b-ed6b-4edb-8572-f09482ee9fd5 req-f831804f-44cf-49af-8abf-2c2cf728bbe9 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:39:14.107879 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.compute.server_external_events [req-ff737a8b-ed6b-4edb-8572-f09482ee9fd5 req-f831804f-44cf-49af-8abf-2c2cf728bbe9 service nova] Creating event network-changed:c0ab3804-fc2a-4ea2-b784-19b69d342b58 for instance e04724e3-bd2a-49a5-bad8-c9d186bc7211 on hv-cinder-84112 May 19 13:39:14.112861 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [req-ff737a8b-ed6b-4edb-8572-f09482ee9fd5 req-f831804f-44cf-49af-8abf-2c2cf728bbe9 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031741 May 19 13:39:14.114008 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 380/773] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:39:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:39:14.844154 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-a4b16f33-36e0-4f7f-98fd-871ef21274ac tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:39:14.844807 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-a4b16f33-36e0-4f7f-98fd-871ef21274ac tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] [instance: e04724e3-bd2a-49a5-bad8-c9d186bc7211] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:39:14.851612 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-a4b16f33-36e0-4f7f-98fd-871ef21274ac tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:39:14.852060 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-a4b16f33-36e0-4f7f-98fd-871ef21274ac tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:39:14.852822 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-a4b16f33-36e0-4f7f-98fd-871ef21274ac tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:39:14.853250 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-a4b16f33-36e0-4f7f-98fd-871ef21274ac tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:39:14.986004 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-a4b16f33-36e0-4f7f-98fd-871ef21274ac tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0a4b41707d444581ee0aa2296ac0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ad7b921dbc4a8d9e9be0d50385deee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:39:14.994276 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-a4b16f33-36e0-4f7f-98fd-871ef21274ac tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] 10.222.0.24 "GET /compute/v2.1/servers/e04724e3-bd2a-49a5-bad8-c9d186bc7211" status: 200 len: 1266 microversion: 2.1 time: 0.155020 May 19 13:39:14.994844 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 394/774] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:39:14 2022] GET /compute/v2.1/servers/e04724e3-bd2a-49a5-bad8-c9d186bc7211 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:39:16.012831 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-19b6afae-3c42-41e2-8d44-307d6e524eef tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:39:16.014210 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-19b6afae-3c42-41e2-8d44-307d6e524eef tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] [instance: e04724e3-bd2a-49a5-bad8-c9d186bc7211] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:39:16.022571 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-19b6afae-3c42-41e2-8d44-307d6e524eef tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:39:16.023782 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-19b6afae-3c42-41e2-8d44-307d6e524eef tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:39:16.024646 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-19b6afae-3c42-41e2-8d44-307d6e524eef tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:39:16.025274 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-19b6afae-3c42-41e2-8d44-307d6e524eef tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:39:16.179920 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-19b6afae-3c42-41e2-8d44-307d6e524eef tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0a4b41707d444581ee0aa2296ac0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ad7b921dbc4a8d9e9be0d50385deee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:39:16.187799 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-19b6afae-3c42-41e2-8d44-307d6e524eef tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] 10.222.0.24 "GET /compute/v2.1/servers/e04724e3-bd2a-49a5-bad8-c9d186bc7211" status: 200 len: 1266 microversion: 2.1 time: 0.179779 May 19 13:39:16.188289 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 381/775] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:39:16 2022] GET /compute/v2.1/servers/e04724e3-bd2a-49a5-bad8-c9d186bc7211 => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:39:17.207630 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-3ba7f371-cac0-4fbc-b615-90babc3bbe4d tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:39:17.208233 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-3ba7f371-cac0-4fbc-b615-90babc3bbe4d tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] [instance: e04724e3-bd2a-49a5-bad8-c9d186bc7211] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:39:17.216130 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-3ba7f371-cac0-4fbc-b615-90babc3bbe4d tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:39:17.216648 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-3ba7f371-cac0-4fbc-b615-90babc3bbe4d tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:39:17.217496 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-3ba7f371-cac0-4fbc-b615-90babc3bbe4d tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:39:17.217933 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-3ba7f371-cac0-4fbc-b615-90babc3bbe4d tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:39:17.375239 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-3ba7f371-cac0-4fbc-b615-90babc3bbe4d tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0a4b41707d444581ee0aa2296ac0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ad7b921dbc4a8d9e9be0d50385deee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:39:17.386588 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-3ba7f371-cac0-4fbc-b615-90babc3bbe4d tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] 10.222.0.24 "GET /compute/v2.1/servers/e04724e3-bd2a-49a5-bad8-c9d186bc7211" status: 200 len: 1266 microversion: 2.1 time: 0.182746 May 19 13:39:17.387428 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 395/776] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:39:17 2022] GET /compute/v2.1/servers/e04724e3-bd2a-49a5-bad8-c9d186bc7211 => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:39:18.404346 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-b88f6458-c5ec-4af2-a9cf-a926a0871f1a tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:39:18.405201 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-b88f6458-c5ec-4af2-a9cf-a926a0871f1a tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] [instance: e04724e3-bd2a-49a5-bad8-c9d186bc7211] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:39:18.407554 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:39:18.412917 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-b88f6458-c5ec-4af2-a9cf-a926a0871f1a tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:39:18.413357 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-b88f6458-c5ec-4af2-a9cf-a926a0871f1a tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:39:18.414139 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-b88f6458-c5ec-4af2-a9cf-a926a0871f1a tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:39:18.414560 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-b88f6458-c5ec-4af2-a9cf-a926a0871f1a tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:39:18.417987 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:39:18.553774 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-b88f6458-c5ec-4af2-a9cf-a926a0871f1a tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0a4b41707d444581ee0aa2296ac0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ad7b921dbc4a8d9e9be0d50385deee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:39:18.562061 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-b88f6458-c5ec-4af2-a9cf-a926a0871f1a tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] 10.222.0.24 "GET /compute/v2.1/servers/e04724e3-bd2a-49a5-bad8-c9d186bc7211" status: 200 len: 1266 microversion: 2.1 time: 0.161011 May 19 13:39:18.562934 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 382/777] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:39:18 2022] GET /compute/v2.1/servers/e04724e3-bd2a-49a5-bad8-c9d186bc7211 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:39:19.582360 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-bb41f0ea-35c5-489e-844e-554338350986 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:39:19.583718 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-bb41f0ea-35c5-489e-844e-554338350986 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] [instance: e04724e3-bd2a-49a5-bad8-c9d186bc7211] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:39:19.587413 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_api:SELECT=33 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:39:19.595298 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-bb41f0ea-35c5-489e-844e-554338350986 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:39:19.595810 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-bb41f0ea-35c5-489e-844e-554338350986 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:39:19.596750 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-bb41f0ea-35c5-489e-844e-554338350986 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:39:19.597285 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-bb41f0ea-35c5-489e-844e-554338350986 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:39:19.601198 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:39:19.743038 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-bb41f0ea-35c5-489e-844e-554338350986 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0a4b41707d444581ee0aa2296ac0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ad7b921dbc4a8d9e9be0d50385deee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:39:19.751491 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-bb41f0ea-35c5-489e-844e-554338350986 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] 10.222.0.24 "GET /compute/v2.1/servers/e04724e3-bd2a-49a5-bad8-c9d186bc7211" status: 200 len: 1266 microversion: 2.1 time: 0.176578 May 19 13:39:19.752071 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 396/778] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:39:19 2022] GET /compute/v2.1/servers/e04724e3-bd2a-49a5-bad8-c9d186bc7211 => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:39:20.768933 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-548f5079-8ad4-4f64-8e11-0aca20ba4ada tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:39:20.769717 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-548f5079-8ad4-4f64-8e11-0aca20ba4ada tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] [instance: e04724e3-bd2a-49a5-bad8-c9d186bc7211] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:39:20.776444 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-548f5079-8ad4-4f64-8e11-0aca20ba4ada tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:39:20.776895 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-548f5079-8ad4-4f64-8e11-0aca20ba4ada tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:39:20.777687 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-548f5079-8ad4-4f64-8e11-0aca20ba4ada tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:39:20.778119 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-548f5079-8ad4-4f64-8e11-0aca20ba4ada tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:39:20.913231 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-548f5079-8ad4-4f64-8e11-0aca20ba4ada tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0a4b41707d444581ee0aa2296ac0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ad7b921dbc4a8d9e9be0d50385deee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:39:20.921716 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-548f5079-8ad4-4f64-8e11-0aca20ba4ada tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] 10.222.0.24 "GET /compute/v2.1/servers/e04724e3-bd2a-49a5-bad8-c9d186bc7211" status: 200 len: 1266 microversion: 2.1 time: 0.156629 May 19 13:39:20.922319 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 383/779] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:39:20 2022] GET /compute/v2.1/servers/e04724e3-bd2a-49a5-bad8-c9d186bc7211 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:39:21.941259 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-0bb6a26d-faa9-4399-89fb-d188fd1dca95 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:39:21.941876 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-0bb6a26d-faa9-4399-89fb-d188fd1dca95 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] [instance: e04724e3-bd2a-49a5-bad8-c9d186bc7211] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:39:21.944224 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_cell0:SELECT=2 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:39:21.950242 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-0bb6a26d-faa9-4399-89fb-d188fd1dca95 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:39:21.950694 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-0bb6a26d-faa9-4399-89fb-d188fd1dca95 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:39:21.951459 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-0bb6a26d-faa9-4399-89fb-d188fd1dca95 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:39:21.952355 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-0bb6a26d-faa9-4399-89fb-d188fd1dca95 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:39:22.094182 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-0bb6a26d-faa9-4399-89fb-d188fd1dca95 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0a4b41707d444581ee0aa2296ac0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ad7b921dbc4a8d9e9be0d50385deee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:39:22.102869 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-0bb6a26d-faa9-4399-89fb-d188fd1dca95 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] 10.222.0.24 "GET /compute/v2.1/servers/e04724e3-bd2a-49a5-bad8-c9d186bc7211" status: 200 len: 1266 microversion: 2.1 time: 0.165474 May 19 13:39:22.103604 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 397/780] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:39:21 2022] GET /compute/v2.1/servers/e04724e3-bd2a-49a5-bad8-c9d186bc7211 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:39:23.121890 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-25a9dd85-714e-4613-8e5c-93783cbb4cbb tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:39:23.122516 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-25a9dd85-714e-4613-8e5c-93783cbb4cbb tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] [instance: e04724e3-bd2a-49a5-bad8-c9d186bc7211] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:39:23.125936 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_cell0:SELECT=2 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:39:23.127051 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_cell0:SELECT=6 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:39:23.134308 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-25a9dd85-714e-4613-8e5c-93783cbb4cbb tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:39:23.134924 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-25a9dd85-714e-4613-8e5c-93783cbb4cbb tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:39:23.135849 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-25a9dd85-714e-4613-8e5c-93783cbb4cbb tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:39:23.136280 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-25a9dd85-714e-4613-8e5c-93783cbb4cbb tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:39:23.286471 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-25a9dd85-714e-4613-8e5c-93783cbb4cbb tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0a4b41707d444581ee0aa2296ac0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ad7b921dbc4a8d9e9be0d50385deee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:39:23.294201 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-25a9dd85-714e-4613-8e5c-93783cbb4cbb tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] 10.222.0.24 "GET /compute/v2.1/servers/e04724e3-bd2a-49a5-bad8-c9d186bc7211" status: 200 len: 1266 microversion: 2.1 time: 0.177145 May 19 13:39:23.294836 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 384/781] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:39:23 2022] GET /compute/v2.1/servers/e04724e3-bd2a-49a5-bad8-c9d186bc7211 => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:39:23.618283 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [req-a17af309-6a9c-4b6d-93ab-4ca3db748cf8 req-cf71f4c7-b526-4e24-b8d3-9f01c958190b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e04724e3-bd2a-49a5-bad8-c9d186bc7211", "name": "network-vif-plugged", "status": "completed", "tag": "c0ab3804-fc2a-4ea2-b784-19b69d342b58"}]} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:39:23.631141 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-a17af309-6a9c-4b6d-93ab-4ca3db748cf8 req-cf71f4c7-b526-4e24-b8d3-9f01c958190b service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:39:23.631917 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-a17af309-6a9c-4b6d-93ab-4ca3db748cf8 req-cf71f4c7-b526-4e24-b8d3-9f01c958190b service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:39:23.646413 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.compute.server_external_events [req-a17af309-6a9c-4b6d-93ab-4ca3db748cf8 req-cf71f4c7-b526-4e24-b8d3-9f01c958190b service nova] Creating event network-vif-plugged:c0ab3804-fc2a-4ea2-b784-19b69d342b58 for instance e04724e3-bd2a-49a5-bad8-c9d186bc7211 on hv-cinder-84112 May 19 13:39:23.652210 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [req-a17af309-6a9c-4b6d-93ab-4ca3db748cf8 req-cf71f4c7-b526-4e24-b8d3-9f01c958190b service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039642 May 19 13:39:23.652809 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 398/782] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:39:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:39:24.312572 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-f716c4a8-5636-488a-a660-7c174aad55a4 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:39:24.313189 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-f716c4a8-5636-488a-a660-7c174aad55a4 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] [instance: e04724e3-bd2a-49a5-bad8-c9d186bc7211] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:39:24.319956 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-f716c4a8-5636-488a-a660-7c174aad55a4 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:39:24.320454 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-f716c4a8-5636-488a-a660-7c174aad55a4 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:39:24.321186 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-f716c4a8-5636-488a-a660-7c174aad55a4 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:39:24.321633 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-f716c4a8-5636-488a-a660-7c174aad55a4 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:39:24.482003 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-f716c4a8-5636-488a-a660-7c174aad55a4 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0a4b41707d444581ee0aa2296ac0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ad7b921dbc4a8d9e9be0d50385deee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:39:24.490103 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-f716c4a8-5636-488a-a660-7c174aad55a4 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] 10.222.0.24 "GET /compute/v2.1/servers/e04724e3-bd2a-49a5-bad8-c9d186bc7211" status: 200 len: 1266 microversion: 2.1 time: 0.181736 May 19 13:39:24.490640 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 385/783] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:39:24 2022] GET /compute/v2.1/servers/e04724e3-bd2a-49a5-bad8-c9d186bc7211 => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:39:25.510219 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-ae6b3dd9-26a0-42e1-bdd8-69e43037637a tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:39:25.511112 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-ae6b3dd9-26a0-42e1-bdd8-69e43037637a tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] [instance: e04724e3-bd2a-49a5-bad8-c9d186bc7211] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:39:25.519295 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-ae6b3dd9-26a0-42e1-bdd8-69e43037637a tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:39:25.519667 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-ae6b3dd9-26a0-42e1-bdd8-69e43037637a tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:39:25.520631 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-ae6b3dd9-26a0-42e1-bdd8-69e43037637a tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:39:25.521241 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-ae6b3dd9-26a0-42e1-bdd8-69e43037637a tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:39:25.673517 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-ae6b3dd9-26a0-42e1-bdd8-69e43037637a tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0a4b41707d444581ee0aa2296ac0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ad7b921dbc4a8d9e9be0d50385deee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:39:25.683057 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-ae6b3dd9-26a0-42e1-bdd8-69e43037637a tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] 10.222.0.24 "GET /compute/v2.1/servers/e04724e3-bd2a-49a5-bad8-c9d186bc7211" status: 200 len: 1453 microversion: 2.1 time: 0.178502 May 19 13:39:25.684025 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 399/784] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:39:25 2022] GET /compute/v2.1/servers/e04724e3-bd2a-49a5-bad8-c9d186bc7211 => generated 1453 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:39:25.707059 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-37ee4d52-44d3-4abe-82e5-61f00a3fcbf8 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:39:25.708735 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-37ee4d52-44d3-4abe-82e5-61f00a3fcbf8 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] [instance: e04724e3-bd2a-49a5-bad8-c9d186bc7211] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:39:25.719642 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-37ee4d52-44d3-4abe-82e5-61f00a3fcbf8 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:39:25.720146 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-37ee4d52-44d3-4abe-82e5-61f00a3fcbf8 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:39:25.720985 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-37ee4d52-44d3-4abe-82e5-61f00a3fcbf8 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:39:25.721610 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-37ee4d52-44d3-4abe-82e5-61f00a3fcbf8 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:39:25.866781 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-37ee4d52-44d3-4abe-82e5-61f00a3fcbf8 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0a4b41707d444581ee0aa2296ac0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ad7b921dbc4a8d9e9be0d50385deee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:39:25.874605 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-37ee4d52-44d3-4abe-82e5-61f00a3fcbf8 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] 10.222.0.24 "GET /compute/v2.1/servers/e04724e3-bd2a-49a5-bad8-c9d186bc7211" status: 200 len: 1453 microversion: 2.1 time: 0.173830 May 19 13:39:25.875170 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 386/785] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:39:25 2022] GET /compute/v2.1/servers/e04724e3-bd2a-49a5-bad8-c9d186bc7211 => generated 1453 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:39:28.242342 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [req-bf8256bf-0d27-48fd-9d71-49faae088968 req-7b427ec7-3c50-4a73-bc18-b15c451ac9c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e04724e3-bd2a-49a5-bad8-c9d186bc7211", "tag": "c0ab3804-fc2a-4ea2-b784-19b69d342b58"}]} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:39:28.252152 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-bf8256bf-0d27-48fd-9d71-49faae088968 req-7b427ec7-3c50-4a73-bc18-b15c451ac9c2 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:39:28.252920 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-bf8256bf-0d27-48fd-9d71-49faae088968 req-7b427ec7-3c50-4a73-bc18-b15c451ac9c2 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:39:28.265362 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.compute.server_external_events [req-bf8256bf-0d27-48fd-9d71-49faae088968 req-7b427ec7-3c50-4a73-bc18-b15c451ac9c2 service nova] Creating event network-changed:c0ab3804-fc2a-4ea2-b784-19b69d342b58 for instance e04724e3-bd2a-49a5-bad8-c9d186bc7211 on hv-cinder-84112 May 19 13:39:28.270706 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [req-bf8256bf-0d27-48fd-9d71-49faae088968 req-7b427ec7-3c50-4a73-bc18-b15c451ac9c2 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036686 May 19 13:39:28.271291 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 400/786] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:39:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:39:34.332374 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-7ff42fda-0ff1-4758-a2ea-13e711c8464b tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:39:34.333324 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-7ff42fda-0ff1-4758-a2ea-13e711c8464b tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [instance: 5b705092-099b-444c-81cf-ecfacd701ac1] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:39:34.339864 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-7ff42fda-0ff1-4758-a2ea-13e711c8464b tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:39:34.340307 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-7ff42fda-0ff1-4758-a2ea-13e711c8464b tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:39:34.341058 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-7ff42fda-0ff1-4758-a2ea-13e711c8464b tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:39:34.341503 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-7ff42fda-0ff1-4758-a2ea-13e711c8464b tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:39:34.373250 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-7ff42fda-0ff1-4758-a2ea-13e711c8464b tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "GET /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044775 May 19 13:39:34.373876 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 387/787] 10.222.0.24 () {58 vars in 1301 bytes} [Thu May 19 13:39:34 2022] GET /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 13:39:34.433875 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-4050db44-abfe-4aef-880a-364761c3e68d tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:39:34.434597 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-4050db44-abfe-4aef-880a-364761c3e68d tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [instance: 5b705092-099b-444c-81cf-ecfacd701ac1] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:39:34.441910 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-4050db44-abfe-4aef-880a-364761c3e68d tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:39:34.442426 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-4050db44-abfe-4aef-880a-364761c3e68d tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:39:34.443334 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-4050db44-abfe-4aef-880a-364761c3e68d tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:39:34.443785 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-4050db44-abfe-4aef-880a-364761c3e68d tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:39:34.469579 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-4050db44-abfe-4aef-880a-364761c3e68d tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [instance: 5b705092-099b-444c-81cf-ecfacd701ac1] Going to try to terminate instance {{(pid=120471) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 13:39:34.548403 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-4050db44-abfe-4aef-880a-364761c3e68d tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "DELETE /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1" status: 204 len: 0 microversion: 2.1 time: 0.119977 May 19 13:39:34.552300 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 401/788] 10.222.0.24 () {58 vars in 1238 bytes} [Thu May 19 13:39:34 2022] DELETE /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 13:39:34.559189 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-a640e952-84ca-4581-a47a-fceabfb292f5 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:39:34.560171 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-a640e952-84ca-4581-a47a-fceabfb292f5 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [instance: 5b705092-099b-444c-81cf-ecfacd701ac1] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:39:34.568702 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-a640e952-84ca-4581-a47a-fceabfb292f5 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:39:34.569179 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-a640e952-84ca-4581-a47a-fceabfb292f5 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:39:34.569972 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-a640e952-84ca-4581-a47a-fceabfb292f5 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:39:34.570406 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-a640e952-84ca-4581-a47a-fceabfb292f5 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:39:34.769242 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-a640e952-84ca-4581-a47a-fceabfb292f5 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883da006d3f4aec8805c74cf5ffae86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1222038740244f69a977fe658d9bfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:39:34.777329 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-a640e952-84ca-4581-a47a-fceabfb292f5 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "GET /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1" status: 200 len: 1673 microversion: 2.1 time: 0.222671 May 19 13:39:34.787317 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 388/789] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:39:34 2022] GET /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1 => generated 1673 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:39:35.795843 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-5e1540eb-1bd1-40dd-b2f2-0685343dd6f9 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:39:35.796961 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-5e1540eb-1bd1-40dd-b2f2-0685343dd6f9 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [instance: 5b705092-099b-444c-81cf-ecfacd701ac1] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:39:35.804672 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-5e1540eb-1bd1-40dd-b2f2-0685343dd6f9 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:39:35.805187 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-5e1540eb-1bd1-40dd-b2f2-0685343dd6f9 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:39:35.806204 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-5e1540eb-1bd1-40dd-b2f2-0685343dd6f9 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:39:35.807029 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-5e1540eb-1bd1-40dd-b2f2-0685343dd6f9 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:39:36.020729 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-5e1540eb-1bd1-40dd-b2f2-0685343dd6f9 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883da006d3f4aec8805c74cf5ffae86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1222038740244f69a977fe658d9bfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:39:36.028761 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-5e1540eb-1bd1-40dd-b2f2-0685343dd6f9 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "GET /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1" status: 200 len: 1673 microversion: 2.1 time: 0.237355 May 19 13:39:36.029317 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 402/790] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:39:35 2022] GET /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1 => generated 1673 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:39:37.050317 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-84342484-e0c8-44e3-93e8-fc23aff791bc tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:39:37.050923 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-84342484-e0c8-44e3-93e8-fc23aff791bc tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [instance: 5b705092-099b-444c-81cf-ecfacd701ac1] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:39:37.060065 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-84342484-e0c8-44e3-93e8-fc23aff791bc tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:39:37.060848 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-84342484-e0c8-44e3-93e8-fc23aff791bc tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:39:37.063197 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-84342484-e0c8-44e3-93e8-fc23aff791bc tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:39:37.063640 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-84342484-e0c8-44e3-93e8-fc23aff791bc tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:39:37.421293 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-84342484-e0c8-44e3-93e8-fc23aff791bc tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883da006d3f4aec8805c74cf5ffae86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1222038740244f69a977fe658d9bfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:39:37.429777 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-84342484-e0c8-44e3-93e8-fc23aff791bc tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "GET /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1" status: 200 len: 1673 microversion: 2.1 time: 0.386907 May 19 13:39:37.442324 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 389/791] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:39:37 2022] GET /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1 => generated 1673 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:39:37.751728 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [req-13e31477-96a1-4736-af9c-14a456024e55 req-69716a32-3b3e-4029-99c3-ddb9c9fcc28e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b705092-099b-444c-81cf-ecfacd701ac1", "name": "network-vif-deleted", "tag": "f893dedd-28aa-4e31-8cfb-add216f8a285"}]} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:39:37.766076 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-13e31477-96a1-4736-af9c-14a456024e55 req-69716a32-3b3e-4029-99c3-ddb9c9fcc28e service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:39:37.766537 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-13e31477-96a1-4736-af9c-14a456024e55 req-69716a32-3b3e-4029-99c3-ddb9c9fcc28e service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:39:37.791742 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.compute.server_external_events [req-13e31477-96a1-4736-af9c-14a456024e55 req-69716a32-3b3e-4029-99c3-ddb9c9fcc28e service nova] Creating event network-vif-deleted:f893dedd-28aa-4e31-8cfb-add216f8a285 for instance 5b705092-099b-444c-81cf-ecfacd701ac1 on hv-cinder-84112 May 19 13:39:37.799855 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [req-13e31477-96a1-4736-af9c-14a456024e55 req-69716a32-3b3e-4029-99c3-ddb9c9fcc28e service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050477 May 19 13:39:37.803617 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 403/792] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:39:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:39:38.447742 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-1f0422c1-610f-4359-8cd1-02361174f63d tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:39:38.459892 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-1f0422c1-610f-4359-8cd1-02361174f63d tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [instance: 5b705092-099b-444c-81cf-ecfacd701ac1] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:39:38.468948 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-1f0422c1-610f-4359-8cd1-02361174f63d tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:39:38.469399 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-1f0422c1-610f-4359-8cd1-02361174f63d tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:39:38.471149 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-1f0422c1-610f-4359-8cd1-02361174f63d tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:39:38.471579 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-1f0422c1-610f-4359-8cd1-02361174f63d tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:39:38.497396 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.wsgi [None req-1f0422c1-610f-4359-8cd1-02361174f63d tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] HTTP exception thrown: Instance 5b705092-099b-444c-81cf-ecfacd701ac1 could not be found. May 19 13:39:38.499844 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-1f0422c1-610f-4359-8cd1-02361174f63d tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Request method failure captured: May 19 13:39:38.499844 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: request: GET /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1 HTTP/1.1 May 19 13:39:38.499844 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Accept: application/json May 19 13:39:38.499844 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Accept-Encoding: identity May 19 13:39:38.499844 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Connection: close May 19 13:39:38.499844 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Content-Length: 0 May 19 13:39:38.499844 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Content-Type: application/json May 19 13:39:38.499844 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Host: 10.222.0.24 May 19 13:39:38.499844 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Openstack-System-Scope: None May 19 13:39:38.499844 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: User-Agent: python-urllib3/1.26.9 May 19 13:39:38.499844 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Auth-Token: gAAAAABihkf3L-05oVTPApCTAuaqZzO4Z_IkS_QBTvRRvPxPUB_gSjd3CBVB-b8VW3Of7Eth8Y5ScY7TtKaQgNpKd1FujsmOFefKf1obNg_P9EG6NP2PVObAvAhXLopnkleR4yM-i_Lb1b-iEGstYj3eSw2p_uMBEOtuV6E51Q3WCT9cXS5YR5c May 19 13:39:38.499844 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Domain-Id: None May 19 13:39:38.499844 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Domain-Name: None May 19 13:39:38.499844 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Identity-Status: Confirmed May 19 13:39:38.499844 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Is-Admin-Project: True May 19 13:39:38.499844 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Domain-Id: default May 19 13:39:38.499844 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Domain-Name: Default May 19 13:39:38.499844 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Id: b1222038740244f69a977fe658d9bfe0 May 19 13:39:38.499844 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Name: tempest-AttachVolumeTestJSON-975255197 May 19 13:39:38.499844 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Role: reader,member May 19 13:39:38.499844 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Roles: reader,member May 19 13:39:38.501592 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/b1222038740244f69a977fe658d9bfe0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/b1222038740244f69a977fe658d9bfe0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_b1222038740244f69a977fe658d9bfe0", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/b1222038740244f69a977fe658d9bfe0"}]}] May 19 13:39:38.501592 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant: tempest-AttachVolumeTestJSON-975255197 May 19 13:39:38.501592 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant-Id: b1222038740244f69a977fe658d9bfe0 May 19 13:39:38.501592 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant-Name: tempest-AttachVolumeTestJSON-975255197 May 19 13:39:38.501592 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User: tempest-AttachVolumeTestJSON-975255197-project May 19 13:39:38.501592 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Domain-Id: default May 19 13:39:38.501592 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Domain-Name: Default May 19 13:39:38.501592 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Id: 6883da006d3f4aec8805c74cf5ffae86 May 19 13:39:38.501592 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Name: tempest-AttachVolumeTestJSON-975255197-project May 19 13:39:38.501592 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: method: > May 19 13:39:38.501592 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: exception: Instance 5b705092-099b-444c-81cf-ecfacd701ac1 could not be found. May 19 13:39:38.501592 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: action_args: {'id': '5b705092-099b-444c-81cf-ecfacd701ac1'} May 19 13:39:38.502698 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:39:38.502698 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:39:38.502698 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 13:39:38.502698 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 13:39:38.502698 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 13:39:38.502698 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 13:39:38.502698 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 13:39:38.502698 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 13:39:38.502698 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 13:39:38.502698 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 13:39:38.502698 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b705092-099b-444c-81cf-ecfacd701ac1 could not be found. May 19 13:39:38.502698 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:39:38.502698 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:39:38.502698 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:39:38.502698 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:39:38.502698 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:39:38.502698 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:39:38.502698 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:39:38.502698 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:39:38.502698 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:39:38.504856 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:39:38.504856 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 13:39:38.504856 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 13:39:38.504856 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 13:39:38.504856 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 13:39:38.504856 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 13:39:38.504856 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 13:39:38.504856 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b705092-099b-444c-81cf-ecfacd701ac1 could not be found. May 19 13:39:38.504856 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:39:38.504856 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:39:38.504856 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:39:38.504856 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:39:38.504856 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:39:38.504856 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:39:38.504856 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:39:38.504856 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:39:38.504856 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b705092-099b-444c-81cf-ecfacd701ac1 could not be found. May 19 13:39:38.504856 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:39:38.508189 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-1f0422c1-610f-4359-8cd1-02361174f63d tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Returning 404 to user: Instance 5b705092-099b-444c-81cf-ecfacd701ac1 could not be found. {{(pid=120472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:39:38.509351 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-1f0422c1-610f-4359-8cd1-02361174f63d tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "GET /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1" status: 404 len: 111 microversion: 2.1 time: 0.065727 May 19 13:39:38.521619 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-b4ef24bd-eebc-4745-af8c-699f350db1d0 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Calling method '.version_select at 0x7f7c2ae26af0>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:39:38.526694 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 390/793] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:39:38 2022] GET /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 13:39:38.546509 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-b4ef24bd-eebc-4745-af8c-699f350db1d0 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1063460404" status: 202 len: 0 microversion: 2.1 time: 0.029925 May 19 13:39:38.553498 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 404/794] 10.222.0.24 () {58 vars in 1220 bytes} [Thu May 19 13:39:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1063460404 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 13:39:39.931294 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-d53c5353-d96a-4f2b-b342-f97e7754548f tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Action: 'create', calling method: .version_select at 0x7f7c2a7a6c10>, body: {"keypair": {"name": "tempest-keypair-305984050", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMEs5Afu03L049I/QDfHmXUevgAqFWOao5spkwVjsy4bSbpSHwbbObq0h41eAXJFUDYx3vkeqOI6xHPEi7q37OTObEFFhB1S16hVriI9EBlR5S19HiEqO/7G1Rb+TTTDig=="}} {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:39:39.948938 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.quota [None req-d53c5353-d96a-4f2b-b342-f97e7754548f tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Getting quotas for project b1222038740244f69a977fe658d9bfe0. Resources: {'key_pairs'} {{(pid=120472) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 13:39:39.954628 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.quota [None req-d53c5353-d96a-4f2b-b342-f97e7754548f tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Getting quotas for user 6883da006d3f4aec8805c74cf5ffae86 and project b1222038740244f69a977fe658d9bfe0. Resources: {'key_pairs'} {{(pid=120472) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 13:39:39.969356 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d53c5353-d96a-4f2b-b342-f97e7754548f tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [f15b97b2-e184-4aaf-8add-f64fb8c51046] AMQP server on 10.222.0.24:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 19 13:39:40.977489 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO oslo.messaging._drivers.impl_rabbit [None req-d53c5353-d96a-4f2b-b342-f97e7754548f tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [f15b97b2-e184-4aaf-8add-f64fb8c51046] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 39384. May 19 13:39:40.995329 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-d53c5353-d96a-4f2b-b342-f97e7754548f tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.068391 May 19 13:39:40.996238 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 391/795] 10.222.0.24 () {60 vars in 1158 bytes} [Thu May 19 13:39:39 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:39:42.815250 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-16e50da1-3733-4d4a-9e5a-cd793bfe7fbf tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-536297841", "imageRef": "9beb860d-9c3f-4244-80aa-71a9c337a429", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c86071f6-6021-438e-94aa-a1421372fa5c"}], "security_groups": [{"name": "tempest-securitygroup--1989992794"}], "key_name": "tempest-keypair-305984050", "user_data": "}} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:39:42.988419 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.network.neutron [None req-16e50da1-3733-4d4a-9e5a-cd793bfe7fbf tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] validate_networks() for [('c86071f6-6021-438e-94aa-a1421372fa5c', None, None, None, None, None)] {{(pid=120471) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 13:39:43.845194 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.virt.hardware [None req-16e50da1-3733-4d4a-9e5a-cd793bfe7fbf tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Flavor limits 0:0:0 {{(pid=120471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 13:39:43.845899 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.virt.hardware [None req-16e50da1-3733-4d4a-9e5a-cd793bfe7fbf tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Image limits 0:0:0 {{(pid=120471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 13:39:43.846105 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.virt.hardware [None req-16e50da1-3733-4d4a-9e5a-cd793bfe7fbf tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Flavor pref 0:0:0 {{(pid=120471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 13:39:43.846499 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.virt.hardware [None req-16e50da1-3733-4d4a-9e5a-cd793bfe7fbf tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Image pref 0:0:0 {{(pid=120471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 13:39:43.846897 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.virt.hardware [None req-16e50da1-3733-4d4a-9e5a-cd793bfe7fbf tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 13:39:43.858804 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-16e50da1-3733-4d4a-9e5a-cd793bfe7fbf tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:39:43.859241 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-16e50da1-3733-4d4a-9e5a-cd793bfe7fbf tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:39:43.860238 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-16e50da1-3733-4d4a-9e5a-cd793bfe7fbf tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:39:43.860664 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-16e50da1-3733-4d4a-9e5a-cd793bfe7fbf tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:39:43.892331 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.quota [None req-16e50da1-3733-4d4a-9e5a-cd793bfe7fbf tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Getting quotas for project b1222038740244f69a977fe658d9bfe0. Resources: {'instances', 'cores', 'ram'} {{(pid=120471) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 13:39:43.897675 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.quota [None req-16e50da1-3733-4d4a-9e5a-cd793bfe7fbf tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Getting quotas for user 6883da006d3f4aec8805c74cf5ffae86 and project b1222038740244f69a977fe658d9bfe0. Resources: {'instances', 'cores', 'ram'} {{(pid=120471) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 13:39:43.919315 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-16e50da1-3733-4d4a-9e5a-cd793bfe7fbf tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Going to run 1 instances... {{(pid=120471) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 13:39:43.922468 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-16e50da1-3733-4d4a-9e5a-cd793bfe7fbf tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [instance: e88cee65-3c7d-43a4-93fd-b4b13242e0b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9beb860d-9c3f-4244-80aa-71a9c337a429',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120471) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 13:39:43.982705 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-16e50da1-3733-4d4a-9e5a-cd793bfe7fbf tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.172780 May 19 13:39:43.996352 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-5f78ac07-794d-4ce6-855f-50c10f5a86e2 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:39:43.999394 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 405/796] 10.222.0.24 () {60 vars in 1146 bytes} [Thu May 19 13:39:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 1179 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 13:39:44.000237 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-5f78ac07-794d-4ce6-855f-50c10f5a86e2 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [instance: e88cee65-3c7d-43a4-93fd-b4b13242e0b6] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:39:44.100565 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-5f78ac07-794d-4ce6-855f-50c10f5a86e2 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883da006d3f4aec8805c74cf5ffae86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1222038740244f69a977fe658d9bfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:39:44.108809 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-5f78ac07-794d-4ce6-855f-50c10f5a86e2 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "GET /compute/v2.1/servers/e88cee65-3c7d-43a4-93fd-b4b13242e0b6" status: 200 len: 1236 microversion: 2.1 time: 0.119144 May 19 13:39:44.111558 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 392/797] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:39:43 2022] GET /compute/v2.1/servers/e88cee65-3c7d-43a4-93fd-b4b13242e0b6 => generated 1236 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:39:45.128676 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-818e33c6-aa31-4daf-9f31-4400b507e3dd tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:39:45.129369 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-818e33c6-aa31-4daf-9f31-4400b507e3dd tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [instance: e88cee65-3c7d-43a4-93fd-b4b13242e0b6] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:39:45.209497 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-818e33c6-aa31-4daf-9f31-4400b507e3dd tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883da006d3f4aec8805c74cf5ffae86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1222038740244f69a977fe658d9bfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:39:45.217140 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-818e33c6-aa31-4daf-9f31-4400b507e3dd tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "GET /compute/v2.1/servers/e88cee65-3c7d-43a4-93fd-b4b13242e0b6" status: 200 len: 1236 microversion: 2.1 time: 0.095065 May 19 13:39:45.218145 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 406/798] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:39:45 2022] GET /compute/v2.1/servers/e88cee65-3c7d-43a4-93fd-b4b13242e0b6 => generated 1236 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:39:46.234442 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-6d8d78a5-b963-493f-9302-c83558f8d888 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:39:46.235739 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-6d8d78a5-b963-493f-9302-c83558f8d888 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [instance: e88cee65-3c7d-43a4-93fd-b4b13242e0b6] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:39:46.310721 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-6d8d78a5-b963-493f-9302-c83558f8d888 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883da006d3f4aec8805c74cf5ffae86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1222038740244f69a977fe658d9bfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:39:46.318380 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-6d8d78a5-b963-493f-9302-c83558f8d888 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "GET /compute/v2.1/servers/e88cee65-3c7d-43a4-93fd-b4b13242e0b6" status: 200 len: 1236 microversion: 2.1 time: 0.087941 May 19 13:39:46.319191 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 407/799] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:39:46 2022] GET /compute/v2.1/servers/e88cee65-3c7d-43a4-93fd-b4b13242e0b6 => generated 1236 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:39:46.334019 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-7dc3b266-7f13-49d1-a560-f500eb24bd02 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Action: 'create', calling method: .version_select at 0x7f7c2a748a60>, body: {"keypair": {"name": "tempest-TestShelveInstance-920606449", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHEmNG1Poq1BgTSsW/q/hGyb5zf8KGnoRVgkNVdZSUETqpgE3NboJ4APoYD+C7Svhc84kCAZOjJGQGGestSIiTcua4lTBPcPNCSpDACzM0vZ54ki2DpBz8CKeGHdZ0aovw=="}} {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:39:46.349889 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.quota [None req-7dc3b266-7f13-49d1-a560-f500eb24bd02 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Getting quotas for project 430899def10d40c192f0d54b8ebf0af5. Resources: {'key_pairs'} {{(pid=120472) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 13:39:46.354211 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.quota [None req-7dc3b266-7f13-49d1-a560-f500eb24bd02 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Getting quotas for user 9485d40bf82e421bafbb714c60c96df2 and project 430899def10d40c192f0d54b8ebf0af5. Resources: {'key_pairs'} {{(pid=120472) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 13:39:46.377564 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-7dc3b266-7f13-49d1-a560-f500eb24bd02 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.291140 May 19 13:39:46.378156 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 393/800] 10.222.0.24 () {60 vars in 1158 bytes} [Thu May 19 13:39:46 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:39:47.335688 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-8c5e3af8-6b38-429c-8ba7-ac2888301363 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:39:47.336332 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-8c5e3af8-6b38-429c-8ba7-ac2888301363 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [instance: e88cee65-3c7d-43a4-93fd-b4b13242e0b6] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:39:47.406568 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-8c5e3af8-6b38-429c-8ba7-ac2888301363 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883da006d3f4aec8805c74cf5ffae86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1222038740244f69a977fe658d9bfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:39:47.419250 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-8c5e3af8-6b38-429c-8ba7-ac2888301363 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "GET /compute/v2.1/servers/e88cee65-3c7d-43a4-93fd-b4b13242e0b6" status: 200 len: 1236 microversion: 2.1 time: 0.087371 May 19 13:39:47.419900 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 408/801] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:39:47 2022] GET /compute/v2.1/servers/e88cee65-3c7d-43a4-93fd-b4b13242e0b6 => generated 1236 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:39:48.442162 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-b0b7df5d-c2e6-4a97-95c0-4e2373b87bab tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:39:48.443685 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-b0b7df5d-c2e6-4a97-95c0-4e2373b87bab tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [instance: e88cee65-3c7d-43a4-93fd-b4b13242e0b6] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:39:48.451228 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=2 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:39:48.454715 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-b0b7df5d-c2e6-4a97-95c0-4e2373b87bab tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:39:48.455456 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-b0b7df5d-c2e6-4a97-95c0-4e2373b87bab tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:39:48.456275 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-b0b7df5d-c2e6-4a97-95c0-4e2373b87bab tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:39:48.457139 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-b0b7df5d-c2e6-4a97-95c0-4e2373b87bab tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:39:48.460901 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_cell1:SELECT=50 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:39:48.534042 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-b0b7df5d-c2e6-4a97-95c0-4e2373b87bab tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883da006d3f4aec8805c74cf5ffae86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1222038740244f69a977fe658d9bfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:39:48.545020 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-b0b7df5d-c2e6-4a97-95c0-4e2373b87bab tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "GET /compute/v2.1/servers/e88cee65-3c7d-43a4-93fd-b4b13242e0b6" status: 200 len: 1240 microversion: 2.1 time: 0.108157 May 19 13:39:48.545020 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 394/802] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:39:48 2022] GET /compute/v2.1/servers/e88cee65-3c7d-43a4-93fd-b4b13242e0b6 => generated 1240 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:39:49.572393 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-f8cfe30e-fbe1-4ba3-8ca2-96b7a83c99b9 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:39:49.574111 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-f8cfe30e-fbe1-4ba3-8ca2-96b7a83c99b9 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [instance: e88cee65-3c7d-43a4-93fd-b4b13242e0b6] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:39:49.596796 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-f8cfe30e-fbe1-4ba3-8ca2-96b7a83c99b9 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:39:49.598325 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-f8cfe30e-fbe1-4ba3-8ca2-96b7a83c99b9 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:39:49.599451 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-f8cfe30e-fbe1-4ba3-8ca2-96b7a83c99b9 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:39:49.602429 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-f8cfe30e-fbe1-4ba3-8ca2-96b7a83c99b9 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:39:49.652244 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:39:49.755104 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-f8cfe30e-fbe1-4ba3-8ca2-96b7a83c99b9 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883da006d3f4aec8805c74cf5ffae86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1222038740244f69a977fe658d9bfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:39:49.765026 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-f8cfe30e-fbe1-4ba3-8ca2-96b7a83c99b9 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "GET /compute/v2.1/servers/e88cee65-3c7d-43a4-93fd-b4b13242e0b6" status: 200 len: 1294 microversion: 2.1 time: 0.201058 May 19 13:39:49.766247 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 409/803] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:39:49 2022] GET /compute/v2.1/servers/e88cee65-3c7d-43a4-93fd-b4b13242e0b6 => generated 1294 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:39:50.784573 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-153e00e6-d0cb-42dd-9e94-66a495962df9 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:39:50.785353 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-153e00e6-d0cb-42dd-9e94-66a495962df9 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [instance: e88cee65-3c7d-43a4-93fd-b4b13242e0b6] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:39:50.792159 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-153e00e6-d0cb-42dd-9e94-66a495962df9 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:39:50.792803 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-153e00e6-d0cb-42dd-9e94-66a495962df9 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:39:50.793607 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-153e00e6-d0cb-42dd-9e94-66a495962df9 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:39:50.794043 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-153e00e6-d0cb-42dd-9e94-66a495962df9 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:39:51.024555 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-153e00e6-d0cb-42dd-9e94-66a495962df9 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883da006d3f4aec8805c74cf5ffae86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1222038740244f69a977fe658d9bfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:39:51.034495 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-153e00e6-d0cb-42dd-9e94-66a495962df9 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "GET /compute/v2.1/servers/e88cee65-3c7d-43a4-93fd-b4b13242e0b6" status: 200 len: 1362 microversion: 2.1 time: 0.255934 May 19 13:39:51.036014 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 395/804] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:39:50 2022] GET /compute/v2.1/servers/e88cee65-3c7d-43a4-93fd-b4b13242e0b6 => generated 1362 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:39:51.279363 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [req-a87863d7-0ac4-43b2-99be-7f5e2c9a96c0 req-d57ee6f3-967b-4827-9867-cd041c53009f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e88cee65-3c7d-43a4-93fd-b4b13242e0b6", "tag": "e8c2fd0a-e98c-4402-9f10-a546495679c3"}]} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:39:51.299612 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:39:51.315505 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-a87863d7-0ac4-43b2-99be-7f5e2c9a96c0 req-d57ee6f3-967b-4827-9867-cd041c53009f service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:39:51.316034 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-a87863d7-0ac4-43b2-99be-7f5e2c9a96c0 req-d57ee6f3-967b-4827-9867-cd041c53009f service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:39:51.329714 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.compute.server_external_events [req-a87863d7-0ac4-43b2-99be-7f5e2c9a96c0 req-d57ee6f3-967b-4827-9867-cd041c53009f service nova] Creating event network-changed:e8c2fd0a-e98c-4402-9f10-a546495679c3 for instance e88cee65-3c7d-43a4-93fd-b4b13242e0b6 on hv-cinder-84112 May 19 13:39:51.335596 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [req-a87863d7-0ac4-43b2-99be-7f5e2c9a96c0 req-d57ee6f3-967b-4827-9867-cd041c53009f service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070035 May 19 13:39:51.336441 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 410/805] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:39:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 13:39:52.052356 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-4c45a1dc-d30e-4e03-a1c8-cbc175dacf99 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:39:52.052922 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-4c45a1dc-d30e-4e03-a1c8-cbc175dacf99 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [instance: e88cee65-3c7d-43a4-93fd-b4b13242e0b6] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:39:52.059784 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-4c45a1dc-d30e-4e03-a1c8-cbc175dacf99 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:39:52.060228 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-4c45a1dc-d30e-4e03-a1c8-cbc175dacf99 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:39:52.060990 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-4c45a1dc-d30e-4e03-a1c8-cbc175dacf99 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:39:52.061662 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-4c45a1dc-d30e-4e03-a1c8-cbc175dacf99 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:39:52.201330 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-4c45a1dc-d30e-4e03-a1c8-cbc175dacf99 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883da006d3f4aec8805c74cf5ffae86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1222038740244f69a977fe658d9bfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:39:52.210064 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-4c45a1dc-d30e-4e03-a1c8-cbc175dacf99 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "GET /compute/v2.1/servers/e88cee65-3c7d-43a4-93fd-b4b13242e0b6" status: 200 len: 1362 microversion: 2.1 time: 0.161693 May 19 13:39:52.210647 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 396/806] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:39:52 2022] GET /compute/v2.1/servers/e88cee65-3c7d-43a4-93fd-b4b13242e0b6 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:39:53.229177 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-0e8af705-2145-49f9-b00c-5ff6d7c9a1b2 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:39:53.229899 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-0e8af705-2145-49f9-b00c-5ff6d7c9a1b2 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [instance: e88cee65-3c7d-43a4-93fd-b4b13242e0b6] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:39:53.237700 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-0e8af705-2145-49f9-b00c-5ff6d7c9a1b2 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:39:53.238156 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-0e8af705-2145-49f9-b00c-5ff6d7c9a1b2 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:39:53.238931 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-0e8af705-2145-49f9-b00c-5ff6d7c9a1b2 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:39:53.239365 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-0e8af705-2145-49f9-b00c-5ff6d7c9a1b2 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:39:53.372056 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-0e8af705-2145-49f9-b00c-5ff6d7c9a1b2 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883da006d3f4aec8805c74cf5ffae86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1222038740244f69a977fe658d9bfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:39:53.379930 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-0e8af705-2145-49f9-b00c-5ff6d7c9a1b2 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "GET /compute/v2.1/servers/e88cee65-3c7d-43a4-93fd-b4b13242e0b6" status: 200 len: 1362 microversion: 2.1 time: 0.156365 May 19 13:39:53.380479 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 411/807] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:39:53 2022] GET /compute/v2.1/servers/e88cee65-3c7d-43a4-93fd-b4b13242e0b6 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:39:54.397731 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-978457bb-ad2c-4d44-b082-350acb17f9c2 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:39:54.398376 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-978457bb-ad2c-4d44-b082-350acb17f9c2 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [instance: e88cee65-3c7d-43a4-93fd-b4b13242e0b6] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:39:54.406036 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-978457bb-ad2c-4d44-b082-350acb17f9c2 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:39:54.406482 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-978457bb-ad2c-4d44-b082-350acb17f9c2 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:39:54.407232 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-978457bb-ad2c-4d44-b082-350acb17f9c2 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:39:54.407685 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-978457bb-ad2c-4d44-b082-350acb17f9c2 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:39:54.547134 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-978457bb-ad2c-4d44-b082-350acb17f9c2 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883da006d3f4aec8805c74cf5ffae86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1222038740244f69a977fe658d9bfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:39:54.554693 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-978457bb-ad2c-4d44-b082-350acb17f9c2 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "GET /compute/v2.1/servers/e88cee65-3c7d-43a4-93fd-b4b13242e0b6" status: 200 len: 1362 microversion: 2.1 time: 0.160988 May 19 13:39:54.555257 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 397/808] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:39:54 2022] GET /compute/v2.1/servers/e88cee65-3c7d-43a4-93fd-b4b13242e0b6 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:39:55.574440 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-41433c69-47ce-45c9-825d-6257d314346d tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:39:55.575041 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-41433c69-47ce-45c9-825d-6257d314346d tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [instance: e88cee65-3c7d-43a4-93fd-b4b13242e0b6] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:39:55.579231 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_cell0:SELECT=2 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:39:55.584222 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-41433c69-47ce-45c9-825d-6257d314346d tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:39:55.584680 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-41433c69-47ce-45c9-825d-6257d314346d tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:39:55.585463 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-41433c69-47ce-45c9-825d-6257d314346d tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:39:55.585961 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-41433c69-47ce-45c9-825d-6257d314346d tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:39:55.732717 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-41433c69-47ce-45c9-825d-6257d314346d tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883da006d3f4aec8805c74cf5ffae86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1222038740244f69a977fe658d9bfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:39:55.741355 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-41433c69-47ce-45c9-825d-6257d314346d tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "GET /compute/v2.1/servers/e88cee65-3c7d-43a4-93fd-b4b13242e0b6" status: 200 len: 1362 microversion: 2.1 time: 0.171397 May 19 13:39:55.742080 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 412/809] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:39:55 2022] GET /compute/v2.1/servers/e88cee65-3c7d-43a4-93fd-b4b13242e0b6 => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:39:55.897950 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [req-4a5117c0-50e7-4998-871c-1847d65c426d req-73b98024-72f9-4ca0-b0a2-ef0f9aa6f398 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e88cee65-3c7d-43a4-93fd-b4b13242e0b6", "name": "network-vif-plugged", "status": "completed", "tag": "e8c2fd0a-e98c-4402-9f10-a546495679c3"}]} {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:39:55.907920 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [req-4a5117c0-50e7-4998-871c-1847d65c426d req-73b98024-72f9-4ca0-b0a2-ef0f9aa6f398 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:39:55.908541 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [req-4a5117c0-50e7-4998-871c-1847d65c426d req-73b98024-72f9-4ca0-b0a2-ef0f9aa6f398 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:39:55.921868 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.compute.server_external_events [req-4a5117c0-50e7-4998-871c-1847d65c426d req-73b98024-72f9-4ca0-b0a2-ef0f9aa6f398 service nova] Creating event network-vif-plugged:e8c2fd0a-e98c-4402-9f10-a546495679c3 for instance e88cee65-3c7d-43a4-93fd-b4b13242e0b6 on hv-cinder-84112 May 19 13:39:55.927685 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [req-4a5117c0-50e7-4998-871c-1847d65c426d req-73b98024-72f9-4ca0-b0a2-ef0f9aa6f398 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033025 May 19 13:39:55.928424 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 398/810] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:39:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:39:56.760189 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-94cf2a7f-2d2e-4fe9-a91f-dcb8b7f638e1 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:39:56.760777 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-94cf2a7f-2d2e-4fe9-a91f-dcb8b7f638e1 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [instance: e88cee65-3c7d-43a4-93fd-b4b13242e0b6] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:39:56.768316 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-94cf2a7f-2d2e-4fe9-a91f-dcb8b7f638e1 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:39:56.768767 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-94cf2a7f-2d2e-4fe9-a91f-dcb8b7f638e1 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:39:56.769561 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-94cf2a7f-2d2e-4fe9-a91f-dcb8b7f638e1 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:39:56.769993 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-94cf2a7f-2d2e-4fe9-a91f-dcb8b7f638e1 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:39:57.182313 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-94cf2a7f-2d2e-4fe9-a91f-dcb8b7f638e1 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883da006d3f4aec8805c74cf5ffae86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1222038740244f69a977fe658d9bfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:39:57.191254 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-94cf2a7f-2d2e-4fe9-a91f-dcb8b7f638e1 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "GET /compute/v2.1/servers/e88cee65-3c7d-43a4-93fd-b4b13242e0b6" status: 200 len: 1362 microversion: 2.1 time: 0.434955 May 19 13:39:57.191864 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 413/811] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:39:56 2022] GET /compute/v2.1/servers/e88cee65-3c7d-43a4-93fd-b4b13242e0b6 => generated 1362 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:39:58.208996 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-d30acc5b-465e-472c-9bda-c37ae6f58f79 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:39:58.209720 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-d30acc5b-465e-472c-9bda-c37ae6f58f79 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [instance: e88cee65-3c7d-43a4-93fd-b4b13242e0b6] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:39:58.211784 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_cell0:SELECT=10 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:39:58.218018 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-d30acc5b-465e-472c-9bda-c37ae6f58f79 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:39:58.218472 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-d30acc5b-465e-472c-9bda-c37ae6f58f79 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:39:58.219231 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-d30acc5b-465e-472c-9bda-c37ae6f58f79 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:39:58.219663 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-d30acc5b-465e-472c-9bda-c37ae6f58f79 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:39:58.358381 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-d30acc5b-465e-472c-9bda-c37ae6f58f79 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883da006d3f4aec8805c74cf5ffae86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1222038740244f69a977fe658d9bfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:39:58.370111 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-d30acc5b-465e-472c-9bda-c37ae6f58f79 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "GET /compute/v2.1/servers/e88cee65-3c7d-43a4-93fd-b4b13242e0b6" status: 200 len: 1547 microversion: 2.1 time: 0.165217 May 19 13:39:58.370914 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 399/812] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:39:58 2022] GET /compute/v2.1/servers/e88cee65-3c7d-43a4-93fd-b4b13242e0b6 => generated 1547 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:39:58.393280 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-ba867b6c-c748-4938-8d6b-6db094a5248d tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:39:58.393857 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-ba867b6c-c748-4938-8d6b-6db094a5248d tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [instance: e88cee65-3c7d-43a4-93fd-b4b13242e0b6] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:39:58.395700 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_cell0:SELECT=12 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:39:58.402309 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-ba867b6c-c748-4938-8d6b-6db094a5248d tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:39:58.402767 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-ba867b6c-c748-4938-8d6b-6db094a5248d tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:39:58.403535 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-ba867b6c-c748-4938-8d6b-6db094a5248d tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:39:58.403970 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-ba867b6c-c748-4938-8d6b-6db094a5248d tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:39:58.486946 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-ba867b6c-c748-4938-8d6b-6db094a5248d tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "GET /compute/v2.1/servers/e88cee65-3c7d-43a4-93fd-b4b13242e0b6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097548 May 19 13:39:58.487503 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 414/813] 10.222.0.24 () {58 vars in 1274 bytes} [Thu May 19 13:39:58 2022] GET /compute/v2.1/servers/e88cee65-3c7d-43a4-93fd-b4b13242e0b6/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 13:39:59.442333 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [req-5fb37b28-edda-4f4b-a566-fefa23734210 req-84b5f3b1-da09-4f84-8e4d-60fec6f247a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e88cee65-3c7d-43a4-93fd-b4b13242e0b6", "tag": "e8c2fd0a-e98c-4402-9f10-a546495679c3"}]} {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:39:59.452065 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [req-5fb37b28-edda-4f4b-a566-fefa23734210 req-84b5f3b1-da09-4f84-8e4d-60fec6f247a6 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:39:59.452507 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [req-5fb37b28-edda-4f4b-a566-fefa23734210 req-84b5f3b1-da09-4f84-8e4d-60fec6f247a6 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:39:59.464367 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.compute.server_external_events [req-5fb37b28-edda-4f4b-a566-fefa23734210 req-84b5f3b1-da09-4f84-8e4d-60fec6f247a6 service nova] Creating event network-changed:e8c2fd0a-e98c-4402-9f10-a546495679c3 for instance e88cee65-3c7d-43a4-93fd-b4b13242e0b6 on hv-cinder-84112 May 19 13:39:59.469374 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [req-5fb37b28-edda-4f4b-a566-fefa23734210 req-84b5f3b1-da09-4f84-8e4d-60fec6f247a6 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030739 May 19 13:39:59.470320 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 400/814] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:39:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:40:02.717389 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-57aff63e-7e62-4c7e-88d0-b2e448b98c4f tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-408949922", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-920606449", "security_groups": [{"name": "tempest-secgroup-smoke-1323013145"}], "networks": [{"uuid": "93c2afc1-4325-416e-818f-45b74ed21db9"}], "block_device_mapping_v2": [{"uuid": "01bd959b-38bf-499a-8780-adc96d66d02e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:40:02.838309 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.network.neutron [None req-57aff63e-7e62-4c7e-88d0-b2e448b98c4f tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] validate_networks() for [('93c2afc1-4325-416e-818f-45b74ed21db9', None, None, None, None, None)] {{(pid=120471) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 13:40:03.223784 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.virt.hardware [None req-57aff63e-7e62-4c7e-88d0-b2e448b98c4f tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Flavor limits 0:0:0 {{(pid=120471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 13:40:03.224210 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.virt.hardware [None req-57aff63e-7e62-4c7e-88d0-b2e448b98c4f tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Image limits 0:0:0 {{(pid=120471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 13:40:03.224842 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.virt.hardware [None req-57aff63e-7e62-4c7e-88d0-b2e448b98c4f tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Flavor pref 0:0:0 {{(pid=120471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 13:40:03.225250 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.virt.hardware [None req-57aff63e-7e62-4c7e-88d0-b2e448b98c4f tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Image pref 0:0:0 {{(pid=120471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 13:40:03.225682 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.virt.hardware [None req-57aff63e-7e62-4c7e-88d0-b2e448b98c4f tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 13:40:03.235431 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-57aff63e-7e62-4c7e-88d0-b2e448b98c4f tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:40:03.235874 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-57aff63e-7e62-4c7e-88d0-b2e448b98c4f tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:40:03.236667 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-57aff63e-7e62-4c7e-88d0-b2e448b98c4f tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:40:03.237096 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-57aff63e-7e62-4c7e-88d0-b2e448b98c4f tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:40:03.254131 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.quota [None req-57aff63e-7e62-4c7e-88d0-b2e448b98c4f tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Getting quotas for project 430899def10d40c192f0d54b8ebf0af5. Resources: {'instances', 'cores', 'ram'} {{(pid=120471) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 13:40:03.258290 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.quota [None req-57aff63e-7e62-4c7e-88d0-b2e448b98c4f tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Getting quotas for user 9485d40bf82e421bafbb714c60c96df2 and project 430899def10d40c192f0d54b8ebf0af5. Resources: {'instances', 'cores', 'ram'} {{(pid=120471) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 13:40:03.318786 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-57aff63e-7e62-4c7e-88d0-b2e448b98c4f tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Going to run 1 instances... {{(pid=120471) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 13:40:03.320899 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-57aff63e-7e62-4c7e-88d0-b2e448b98c4f tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] [instance: b649c85b-1ed3-454b-8ca3-bb53ebc85d91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='01bd959b-38bf-499a-8780-adc96d66d02e',volume_size=None,volume_type=None)] {{(pid=120471) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 13:40:03.454791 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-57aff63e-7e62-4c7e-88d0-b2e448b98c4f tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.741774 May 19 13:40:03.455754 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 415/815] 10.222.0.24 () {60 vars in 1146 bytes} [Thu May 19 13:40:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 743 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 13:40:03.467601 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-ac406b1f-0ad9-42ea-bbfc-09e28ab23663 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:40:03.468289 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-ac406b1f-0ad9-42ea-bbfc-09e28ab23663 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] [instance: b649c85b-1ed3-454b-8ca3-bb53ebc85d91] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:40:03.525730 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-ac406b1f-0ad9-42ea-bbfc-09e28ab23663 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485d40bf82e421bafbb714c60c96df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430899def10d40c192f0d54b8ebf0af5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:40:03.533435 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-ac406b1f-0ad9-42ea-bbfc-09e28ab23663 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] 10.222.0.24 "GET /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91" status: 200 len: 1087 microversion: 2.1 time: 0.070776 May 19 13:40:03.533996 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 401/816] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:40:03 2022] GET /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91 => generated 1087 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:40:04.554305 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-9558d83f-7211-41b2-8bcf-541a0930574c tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:40:04.555030 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-9558d83f-7211-41b2-8bcf-541a0930574c tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] [instance: b649c85b-1ed3-454b-8ca3-bb53ebc85d91] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:40:04.565188 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-9558d83f-7211-41b2-8bcf-541a0930574c tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:40:04.565846 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-9558d83f-7211-41b2-8bcf-541a0930574c tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:40:04.566848 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-9558d83f-7211-41b2-8bcf-541a0930574c tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:40:04.567541 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-9558d83f-7211-41b2-8bcf-541a0930574c tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:40:04.636225 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-9558d83f-7211-41b2-8bcf-541a0930574c tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485d40bf82e421bafbb714c60c96df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430899def10d40c192f0d54b8ebf0af5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:40:04.644197 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-9558d83f-7211-41b2-8bcf-541a0930574c tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] 10.222.0.24 "GET /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91" status: 200 len: 1185 microversion: 2.1 time: 0.096555 May 19 13:40:04.644767 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 416/817] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:40:04 2022] GET /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91 => generated 1185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:40:05.662053 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-20f9a1fa-abfb-4d89-8c02-969626ae09dc tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:40:05.662783 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-20f9a1fa-abfb-4d89-8c02-969626ae09dc tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] [instance: b649c85b-1ed3-454b-8ca3-bb53ebc85d91] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:40:05.670803 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-20f9a1fa-abfb-4d89-8c02-969626ae09dc tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:40:05.671329 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-20f9a1fa-abfb-4d89-8c02-969626ae09dc tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:40:05.672160 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-20f9a1fa-abfb-4d89-8c02-969626ae09dc tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:40:05.672640 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-20f9a1fa-abfb-4d89-8c02-969626ae09dc tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:40:05.919540 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-20f9a1fa-abfb-4d89-8c02-969626ae09dc tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485d40bf82e421bafbb714c60c96df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430899def10d40c192f0d54b8ebf0af5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:40:05.928145 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-20f9a1fa-abfb-4d89-8c02-969626ae09dc tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] 10.222.0.24 "GET /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91" status: 200 len: 1259 microversion: 2.1 time: 0.269936 May 19 13:40:05.928700 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 402/818] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:40:05 2022] GET /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91 => generated 1259 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:40:06.273131 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [req-3c8dd715-bb04-4fc7-a84b-74bb6a5900ad req-bbc92355-c69a-4e82-8c12-29b0475ecbfd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b649c85b-1ed3-454b-8ca3-bb53ebc85d91", "tag": "5d430264-4bd6-4eeb-8a94-9063eff662ea"}]} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:40:06.285552 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-3c8dd715-bb04-4fc7-a84b-74bb6a5900ad req-bbc92355-c69a-4e82-8c12-29b0475ecbfd service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:40:06.289216 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-3c8dd715-bb04-4fc7-a84b-74bb6a5900ad req-bbc92355-c69a-4e82-8c12-29b0475ecbfd service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:40:06.304072 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.compute.server_external_events [req-3c8dd715-bb04-4fc7-a84b-74bb6a5900ad req-bbc92355-c69a-4e82-8c12-29b0475ecbfd service nova] Creating event network-changed:5d430264-4bd6-4eeb-8a94-9063eff662ea for instance b649c85b-1ed3-454b-8ca3-bb53ebc85d91 on hv-cinder-84112 May 19 13:40:06.309658 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [req-3c8dd715-bb04-4fc7-a84b-74bb6a5900ad req-bbc92355-c69a-4e82-8c12-29b0475ecbfd service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040823 May 19 13:40:06.312334 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 417/819] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:40:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:40:06.947806 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-70cb7959-fba8-459c-a4e7-8fc4becb8fd7 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:40:06.948712 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-70cb7959-fba8-459c-a4e7-8fc4becb8fd7 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] [instance: b649c85b-1ed3-454b-8ca3-bb53ebc85d91] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:40:06.959593 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-70cb7959-fba8-459c-a4e7-8fc4becb8fd7 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:40:06.960038 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-70cb7959-fba8-459c-a4e7-8fc4becb8fd7 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:40:06.960803 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-70cb7959-fba8-459c-a4e7-8fc4becb8fd7 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:40:06.961228 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-70cb7959-fba8-459c-a4e7-8fc4becb8fd7 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:40:07.169897 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-70cb7959-fba8-459c-a4e7-8fc4becb8fd7 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485d40bf82e421bafbb714c60c96df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430899def10d40c192f0d54b8ebf0af5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:40:07.178046 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-70cb7959-fba8-459c-a4e7-8fc4becb8fd7 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] 10.222.0.24 "GET /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91" status: 200 len: 1259 microversion: 2.1 time: 0.236358 May 19 13:40:07.178627 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 403/820] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:40:06 2022] GET /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91 => generated 1259 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:40:08.195903 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-c96883a2-b47b-4d2a-b158-bf2250952037 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:40:08.196609 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-c96883a2-b47b-4d2a-b158-bf2250952037 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] [instance: b649c85b-1ed3-454b-8ca3-bb53ebc85d91] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:40:08.203164 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-c96883a2-b47b-4d2a-b158-bf2250952037 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:40:08.203613 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-c96883a2-b47b-4d2a-b158-bf2250952037 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:40:08.204353 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-c96883a2-b47b-4d2a-b158-bf2250952037 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:40:08.204785 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-c96883a2-b47b-4d2a-b158-bf2250952037 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:40:08.342748 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-c96883a2-b47b-4d2a-b158-bf2250952037 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485d40bf82e421bafbb714c60c96df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430899def10d40c192f0d54b8ebf0af5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:40:08.350579 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-c96883a2-b47b-4d2a-b158-bf2250952037 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] 10.222.0.24 "GET /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91" status: 200 len: 1259 microversion: 2.1 time: 0.159520 May 19 13:40:08.351152 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 418/821] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:40:08 2022] GET /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91 => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:40:09.371771 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-10012d86-2531-437e-980c-8006a7ab6bf2 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:40:09.372378 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-10012d86-2531-437e-980c-8006a7ab6bf2 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] [instance: b649c85b-1ed3-454b-8ca3-bb53ebc85d91] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:40:09.382517 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-10012d86-2531-437e-980c-8006a7ab6bf2 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:40:09.382974 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-10012d86-2531-437e-980c-8006a7ab6bf2 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:40:09.383740 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-10012d86-2531-437e-980c-8006a7ab6bf2 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:40:09.384169 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-10012d86-2531-437e-980c-8006a7ab6bf2 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:40:09.522934 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-10012d86-2531-437e-980c-8006a7ab6bf2 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485d40bf82e421bafbb714c60c96df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430899def10d40c192f0d54b8ebf0af5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:40:09.530890 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-10012d86-2531-437e-980c-8006a7ab6bf2 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] 10.222.0.24 "GET /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91" status: 200 len: 1259 microversion: 2.1 time: 0.166817 May 19 13:40:09.531457 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 404/822] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:40:09 2022] GET /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91 => generated 1259 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:40:10.552590 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-a85e90fa-527c-4378-a470-fa07e474af74 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:40:10.553247 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-a85e90fa-527c-4378-a470-fa07e474af74 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] [instance: b649c85b-1ed3-454b-8ca3-bb53ebc85d91] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:40:10.560585 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-a85e90fa-527c-4378-a470-fa07e474af74 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:40:10.561056 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-a85e90fa-527c-4378-a470-fa07e474af74 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:40:10.561898 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-a85e90fa-527c-4378-a470-fa07e474af74 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:40:10.562348 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-a85e90fa-527c-4378-a470-fa07e474af74 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:40:10.714186 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-a85e90fa-527c-4378-a470-fa07e474af74 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485d40bf82e421bafbb714c60c96df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430899def10d40c192f0d54b8ebf0af5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:40:10.722092 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-a85e90fa-527c-4378-a470-fa07e474af74 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] 10.222.0.24 "GET /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91" status: 200 len: 1259 microversion: 2.1 time: 0.176778 May 19 13:40:10.722624 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 419/823] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:40:10 2022] GET /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91 => generated 1259 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:40:11.744188 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-0fb4df74-0c21-413a-aa29-0ba085320ed8 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:40:11.745227 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-0fb4df74-0c21-413a-aa29-0ba085320ed8 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] [instance: b649c85b-1ed3-454b-8ca3-bb53ebc85d91] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:40:11.756477 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-0fb4df74-0c21-413a-aa29-0ba085320ed8 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:40:11.756925 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-0fb4df74-0c21-413a-aa29-0ba085320ed8 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:40:11.757722 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-0fb4df74-0c21-413a-aa29-0ba085320ed8 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:40:11.758148 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-0fb4df74-0c21-413a-aa29-0ba085320ed8 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:40:11.897197 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-0fb4df74-0c21-413a-aa29-0ba085320ed8 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485d40bf82e421bafbb714c60c96df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430899def10d40c192f0d54b8ebf0af5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:40:11.905625 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-0fb4df74-0c21-413a-aa29-0ba085320ed8 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] 10.222.0.24 "GET /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91" status: 200 len: 1259 microversion: 2.1 time: 0.168611 May 19 13:40:11.906212 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 405/824] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:40:11 2022] GET /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91 => generated 1259 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:40:12.927322 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-e35aa4cf-4727-4ef7-86a9-0eb766fbec6c tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:40:12.928598 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-e35aa4cf-4727-4ef7-86a9-0eb766fbec6c tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] [instance: b649c85b-1ed3-454b-8ca3-bb53ebc85d91] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:40:12.936067 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-e35aa4cf-4727-4ef7-86a9-0eb766fbec6c tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:40:12.936516 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-e35aa4cf-4727-4ef7-86a9-0eb766fbec6c tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:40:12.937284 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-e35aa4cf-4727-4ef7-86a9-0eb766fbec6c tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:40:12.937756 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-e35aa4cf-4727-4ef7-86a9-0eb766fbec6c tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:40:13.083359 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-e35aa4cf-4727-4ef7-86a9-0eb766fbec6c tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485d40bf82e421bafbb714c60c96df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430899def10d40c192f0d54b8ebf0af5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:40:13.094608 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-e35aa4cf-4727-4ef7-86a9-0eb766fbec6c tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] 10.222.0.24 "GET /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91" status: 200 len: 1259 microversion: 2.1 time: 0.174073 May 19 13:40:13.095348 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 420/825] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:40:12 2022] GET /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91 => generated 1259 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:40:14.113014 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-bf73041e-d43d-4e64-a700-91f89f232c53 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:40:14.113787 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-bf73041e-d43d-4e64-a700-91f89f232c53 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] [instance: b649c85b-1ed3-454b-8ca3-bb53ebc85d91] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:40:14.116608 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_cell0:SELECT=2 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:40:14.122361 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-bf73041e-d43d-4e64-a700-91f89f232c53 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:40:14.122798 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-bf73041e-d43d-4e64-a700-91f89f232c53 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:40:14.123560 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-bf73041e-d43d-4e64-a700-91f89f232c53 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:40:14.123986 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-bf73041e-d43d-4e64-a700-91f89f232c53 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:40:14.269134 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-bf73041e-d43d-4e64-a700-91f89f232c53 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485d40bf82e421bafbb714c60c96df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430899def10d40c192f0d54b8ebf0af5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:40:14.277459 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-bf73041e-d43d-4e64-a700-91f89f232c53 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] 10.222.0.24 "GET /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91" status: 200 len: 1259 microversion: 2.1 time: 0.169039 May 19 13:40:14.278059 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 406/826] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:40:14 2022] GET /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91 => generated 1259 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:40:15.295939 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-9b49e23a-47b3-4b62-ac4c-33864fb0cd56 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:40:15.296564 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-9b49e23a-47b3-4b62-ac4c-33864fb0cd56 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] [instance: b649c85b-1ed3-454b-8ca3-bb53ebc85d91] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:40:15.298564 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_cell0:SELECT=2 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:40:15.299220 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_cell0:SELECT=6 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:40:15.306185 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-9b49e23a-47b3-4b62-ac4c-33864fb0cd56 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:40:15.306635 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-9b49e23a-47b3-4b62-ac4c-33864fb0cd56 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:40:15.307412 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-9b49e23a-47b3-4b62-ac4c-33864fb0cd56 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:40:15.307844 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-9b49e23a-47b3-4b62-ac4c-33864fb0cd56 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:40:15.440766 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-9b49e23a-47b3-4b62-ac4c-33864fb0cd56 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485d40bf82e421bafbb714c60c96df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430899def10d40c192f0d54b8ebf0af5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:40:15.448919 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-9b49e23a-47b3-4b62-ac4c-33864fb0cd56 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] 10.222.0.24 "GET /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91" status: 200 len: 1259 microversion: 2.1 time: 0.157466 May 19 13:40:15.449523 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 421/827] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:40:15 2022] GET /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:40:16.468304 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-c2a44b9f-392d-4527-8ef5-ff2ee9b39b8c tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:40:16.469117 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-c2a44b9f-392d-4527-8ef5-ff2ee9b39b8c tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] [instance: b649c85b-1ed3-454b-8ca3-bb53ebc85d91] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:40:16.478271 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-c2a44b9f-392d-4527-8ef5-ff2ee9b39b8c tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:40:16.479003 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-c2a44b9f-392d-4527-8ef5-ff2ee9b39b8c tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:40:16.480801 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-c2a44b9f-392d-4527-8ef5-ff2ee9b39b8c tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:40:16.481476 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-c2a44b9f-392d-4527-8ef5-ff2ee9b39b8c tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:40:16.626916 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-c2a44b9f-392d-4527-8ef5-ff2ee9b39b8c tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485d40bf82e421bafbb714c60c96df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430899def10d40c192f0d54b8ebf0af5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:40:16.634821 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-c2a44b9f-392d-4527-8ef5-ff2ee9b39b8c tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] 10.222.0.24 "GET /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91" status: 200 len: 1259 microversion: 2.1 time: 0.171858 May 19 13:40:16.635359 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 407/828] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:40:16 2022] GET /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91 => generated 1259 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:40:17.656452 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-3b5c5c0e-1e6a-426d-96f0-cd0cb5adb0ac tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:40:17.657493 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-3b5c5c0e-1e6a-426d-96f0-cd0cb5adb0ac tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] [instance: b649c85b-1ed3-454b-8ca3-bb53ebc85d91] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:40:17.667015 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-3b5c5c0e-1e6a-426d-96f0-cd0cb5adb0ac tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:40:17.667462 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-3b5c5c0e-1e6a-426d-96f0-cd0cb5adb0ac tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:40:17.668236 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-3b5c5c0e-1e6a-426d-96f0-cd0cb5adb0ac tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:40:17.668670 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-3b5c5c0e-1e6a-426d-96f0-cd0cb5adb0ac tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:40:17.807198 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-3b5c5c0e-1e6a-426d-96f0-cd0cb5adb0ac tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485d40bf82e421bafbb714c60c96df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430899def10d40c192f0d54b8ebf0af5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:40:17.815334 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-3b5c5c0e-1e6a-426d-96f0-cd0cb5adb0ac tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] 10.222.0.24 "GET /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91" status: 200 len: 1259 microversion: 2.1 time: 0.165390 May 19 13:40:17.816785 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 422/829] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:40:17 2022] GET /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91 => generated 1259 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:40:17.820306 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [req-79312639-c266-427e-848c-5245e4c94251 req-ee02ba20-adb3-42b8-9b9f-1e958e2f86ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b649c85b-1ed3-454b-8ca3-bb53ebc85d91", "name": "network-vif-plugged", "status": "completed", "tag": "5d430264-4bd6-4eeb-8a94-9063eff662ea"}]} {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:40:17.830240 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [req-79312639-c266-427e-848c-5245e4c94251 req-ee02ba20-adb3-42b8-9b9f-1e958e2f86ae service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:40:17.830776 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [req-79312639-c266-427e-848c-5245e4c94251 req-ee02ba20-adb3-42b8-9b9f-1e958e2f86ae service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:40:17.843576 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.compute.server_external_events [req-79312639-c266-427e-848c-5245e4c94251 req-ee02ba20-adb3-42b8-9b9f-1e958e2f86ae service nova] Creating event network-vif-plugged:5d430264-4bd6-4eeb-8a94-9063eff662ea for instance b649c85b-1ed3-454b-8ca3-bb53ebc85d91 on hv-cinder-84112 May 19 13:40:17.848719 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [req-79312639-c266-427e-848c-5245e4c94251 req-ee02ba20-adb3-42b8-9b9f-1e958e2f86ae service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032276 May 19 13:40:17.849333 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 408/830] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:40:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 13:40:18.836890 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-f7ca4da7-f58b-49d5-ba3c-ce80e5ea6979 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:40:18.837697 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-f7ca4da7-f58b-49d5-ba3c-ce80e5ea6979 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] [instance: b649c85b-1ed3-454b-8ca3-bb53ebc85d91] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:40:18.846233 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-f7ca4da7-f58b-49d5-ba3c-ce80e5ea6979 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:40:18.846794 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-f7ca4da7-f58b-49d5-ba3c-ce80e5ea6979 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:40:18.847745 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-f7ca4da7-f58b-49d5-ba3c-ce80e5ea6979 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:40:18.848263 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-f7ca4da7-f58b-49d5-ba3c-ce80e5ea6979 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:40:19.004373 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-f7ca4da7-f58b-49d5-ba3c-ce80e5ea6979 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485d40bf82e421bafbb714c60c96df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430899def10d40c192f0d54b8ebf0af5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:40:19.012899 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-f7ca4da7-f58b-49d5-ba3c-ce80e5ea6979 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] 10.222.0.24 "GET /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91" status: 200 len: 1259 microversion: 2.1 time: 0.183110 May 19 13:40:19.013508 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 423/831] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:40:18 2022] GET /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91 => generated 1259 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:40:20.032706 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-296b3bab-0f74-4b99-83d7-71536a96ef94 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:40:20.033344 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-296b3bab-0f74-4b99-83d7-71536a96ef94 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] [instance: b649c85b-1ed3-454b-8ca3-bb53ebc85d91] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:40:20.035445 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_api:SELECT=32 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:40:20.041607 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-296b3bab-0f74-4b99-83d7-71536a96ef94 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:40:20.042053 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-296b3bab-0f74-4b99-83d7-71536a96ef94 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:40:20.042830 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-296b3bab-0f74-4b99-83d7-71536a96ef94 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:40:20.043263 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-296b3bab-0f74-4b99-83d7-71536a96ef94 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:40:20.046427 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_cell1:SELECT=72 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:40:20.183381 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-296b3bab-0f74-4b99-83d7-71536a96ef94 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485d40bf82e421bafbb714c60c96df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430899def10d40c192f0d54b8ebf0af5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:40:20.191376 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-296b3bab-0f74-4b99-83d7-71536a96ef94 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] 10.222.0.24 "GET /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91" status: 200 len: 1443 microversion: 2.1 time: 0.163673 May 19 13:40:20.191952 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 409/832] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:40:20 2022] GET /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91 => generated 1443 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:40:20.207889 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-79eb860f-beb0-40db-a192-a70a4a153ac7 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:40:20.208492 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-79eb860f-beb0-40db-a192-a70a4a153ac7 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] [instance: b649c85b-1ed3-454b-8ca3-bb53ebc85d91] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:40:20.215761 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-79eb860f-beb0-40db-a192-a70a4a153ac7 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:40:20.216206 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-79eb860f-beb0-40db-a192-a70a4a153ac7 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:40:20.216960 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-79eb860f-beb0-40db-a192-a70a4a153ac7 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:40:20.217391 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-79eb860f-beb0-40db-a192-a70a4a153ac7 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:40:20.219963 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_cell1:SELECT=74 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:40:20.354607 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-79eb860f-beb0-40db-a192-a70a4a153ac7 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485d40bf82e421bafbb714c60c96df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430899def10d40c192f0d54b8ebf0af5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:40:20.367027 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-79eb860f-beb0-40db-a192-a70a4a153ac7 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] 10.222.0.24 "GET /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91" status: 200 len: 1443 microversion: 2.1 time: 0.162672 May 19 13:40:20.367995 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 424/833] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:40:20 2022] GET /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91 => generated 1443 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:40:22.331487 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [req-cea83e07-7d1f-4d5b-989b-fc6494052c62 req-1cccc0e6-5cf0-419d-8565-b811338ff00b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b649c85b-1ed3-454b-8ca3-bb53ebc85d91", "tag": "5d430264-4bd6-4eeb-8a94-9063eff662ea"}]} {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:40:22.340963 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [req-cea83e07-7d1f-4d5b-989b-fc6494052c62 req-1cccc0e6-5cf0-419d-8565-b811338ff00b service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:40:22.341432 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [req-cea83e07-7d1f-4d5b-989b-fc6494052c62 req-1cccc0e6-5cf0-419d-8565-b811338ff00b service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:40:22.353334 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.compute.server_external_events [req-cea83e07-7d1f-4d5b-989b-fc6494052c62 req-1cccc0e6-5cf0-419d-8565-b811338ff00b service nova] Creating event network-changed:5d430264-4bd6-4eeb-8a94-9063eff662ea for instance b649c85b-1ed3-454b-8ca3-bb53ebc85d91 on hv-cinder-84112 May 19 13:40:22.358272 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [req-cea83e07-7d1f-4d5b-989b-fc6494052c62 req-1cccc0e6-5cf0-419d-8565-b811338ff00b service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030533 May 19 13:40:22.359011 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 410/834] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:40:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:40:35.315617 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-6fa5ad63-f7e7-4ca9-bf50-b4fbddeae65b tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:40:35.316200 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-6fa5ad63-f7e7-4ca9-bf50-b4fbddeae65b tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [instance: e88cee65-3c7d-43a4-93fd-b4b13242e0b6] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:40:35.318684 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:40:35.319334 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_cell1:SELECT=5 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:40:35.325942 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-6fa5ad63-f7e7-4ca9-bf50-b4fbddeae65b tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:40:35.326394 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-6fa5ad63-f7e7-4ca9-bf50-b4fbddeae65b tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:40:35.327146 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-6fa5ad63-f7e7-4ca9-bf50-b4fbddeae65b tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:40:35.327576 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-6fa5ad63-f7e7-4ca9-bf50-b4fbddeae65b tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:40:35.354523 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-6fa5ad63-f7e7-4ca9-bf50-b4fbddeae65b tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "GET /compute/v2.1/servers/e88cee65-3c7d-43a4-93fd-b4b13242e0b6/ips" status: 200 len: 144 microversion: 2.1 time: 0.043354 May 19 13:40:35.355097 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 425/835] 10.222.0.24 () {58 vars in 1247 bytes} [Thu May 19 13:40:35 2022] GET /compute/v2.1/servers/e88cee65-3c7d-43a4-93fd-b4b13242e0b6/ips => generated 144 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:40:36.687319 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_api:SELECT=3 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:40:36.688063 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_cell1:SELECT=7 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:40:36.693546 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-bf00b740-412e-41f6-a56d-666eefeaae19 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5b16bf3c-507e-49f0-8f1f-02d3ef73f7a6"}} {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:40:36.694687 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-bf00b740-412e-41f6-a56d-666eefeaae19 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [instance: e88cee65-3c7d-43a4-93fd-b4b13242e0b6] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:40:36.701935 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-bf00b740-412e-41f6-a56d-666eefeaae19 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:40:36.702374 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-bf00b740-412e-41f6-a56d-666eefeaae19 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:40:36.703129 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-bf00b740-412e-41f6-a56d-666eefeaae19 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:40:36.703562 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-bf00b740-412e-41f6-a56d-666eefeaae19 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:40:37.009272 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-bf00b740-412e-41f6-a56d-666eefeaae19 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "POST /compute/v2.1/servers/e88cee65-3c7d-43a4-93fd-b4b13242e0b6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.323946 May 19 13:40:37.009960 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 411/836] 10.222.0.24 () {60 vars in 1322 bytes} [Thu May 19 13:40:36 2022] POST /compute/v2.1/servers/e88cee65-3c7d-43a4-93fd-b4b13242e0b6/os-volume_attachments => generated 194 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 13:40:44.608512 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-b5a7006f-0db5-4852-8eb4-f42710beb57f tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:40:44.609442 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-b5a7006f-0db5-4852-8eb4-f42710beb57f tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [instance: e88cee65-3c7d-43a4-93fd-b4b13242e0b6] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:40:44.615989 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-b5a7006f-0db5-4852-8eb4-f42710beb57f tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:40:44.616457 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-b5a7006f-0db5-4852-8eb4-f42710beb57f tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:40:44.617438 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-b5a7006f-0db5-4852-8eb4-f42710beb57f tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:40:44.617887 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-b5a7006f-0db5-4852-8eb4-f42710beb57f tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:40:44.648517 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-b5a7006f-0db5-4852-8eb4-f42710beb57f tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "GET /compute/v2.1/servers/e88cee65-3c7d-43a4-93fd-b4b13242e0b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044567 May 19 13:40:44.649076 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 426/837] 10.222.0.24 () {58 vars in 1301 bytes} [Thu May 19 13:40:44 2022] GET /compute/v2.1/servers/e88cee65-3c7d-43a4-93fd-b4b13242e0b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:40:44.660673 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-ce6056f1-a415-480f-a16b-a526e7c1c7f1 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:40:44.661211 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-ce6056f1-a415-480f-a16b-a526e7c1c7f1 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [instance: e88cee65-3c7d-43a4-93fd-b4b13242e0b6] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:40:44.668111 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-ce6056f1-a415-480f-a16b-a526e7c1c7f1 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:40:44.668542 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-ce6056f1-a415-480f-a16b-a526e7c1c7f1 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:40:44.669290 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-ce6056f1-a415-480f-a16b-a526e7c1c7f1 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:40:44.669715 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-ce6056f1-a415-480f-a16b-a526e7c1c7f1 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:40:44.702338 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-ce6056f1-a415-480f-a16b-a526e7c1c7f1 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "GET /compute/v2.1/servers/e88cee65-3c7d-43a4-93fd-b4b13242e0b6/os-volume_attachments/5b16bf3c-507e-49f0-8f1f-02d3ef73f7a6" status: 200 len: 194 microversion: 2.1 time: 0.046521 May 19 13:40:44.702925 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 412/838] 10.222.0.24 () {58 vars in 1412 bytes} [Thu May 19 13:40:44 2022] GET /compute/v2.1/servers/e88cee65-3c7d-43a4-93fd-b4b13242e0b6/os-volume_attachments/5b16bf3c-507e-49f0-8f1f-02d3ef73f7a6 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:40:46.077845 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-f4d5ee9f-ed7a-4924-8696-2b76a4a57527 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "414edea7-dfe8-4303-b6f8-8943259e6ab8"}} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:40:46.079497 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-f4d5ee9f-ed7a-4924-8696-2b76a4a57527 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [instance: e88cee65-3c7d-43a4-93fd-b4b13242e0b6] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:40:46.089317 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-f4d5ee9f-ed7a-4924-8696-2b76a4a57527 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:40:46.089801 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-f4d5ee9f-ed7a-4924-8696-2b76a4a57527 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:40:46.090567 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-f4d5ee9f-ed7a-4924-8696-2b76a4a57527 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:40:46.091002 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-f4d5ee9f-ed7a-4924-8696-2b76a4a57527 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:40:46.392855 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-f4d5ee9f-ed7a-4924-8696-2b76a4a57527 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "POST /compute/v2.1/servers/e88cee65-3c7d-43a4-93fd-b4b13242e0b6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.322208 May 19 13:40:46.393458 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 427/839] 10.222.0.24 () {60 vars in 1322 bytes} [Thu May 19 13:40:46 2022] POST /compute/v2.1/servers/e88cee65-3c7d-43a4-93fd-b4b13242e0b6/os-volume_attachments => generated 194 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:40:53.954455 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-8f7165af-aa76-47b6-82f2-5954cb2c59a4 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:40:53.955380 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-8f7165af-aa76-47b6-82f2-5954cb2c59a4 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [instance: e88cee65-3c7d-43a4-93fd-b4b13242e0b6] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:40:53.964065 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-8f7165af-aa76-47b6-82f2-5954cb2c59a4 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:40:53.964675 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-8f7165af-aa76-47b6-82f2-5954cb2c59a4 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:40:53.965847 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-8f7165af-aa76-47b6-82f2-5954cb2c59a4 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:40:53.966388 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-8f7165af-aa76-47b6-82f2-5954cb2c59a4 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:40:53.997849 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-8f7165af-aa76-47b6-82f2-5954cb2c59a4 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "GET /compute/v2.1/servers/e88cee65-3c7d-43a4-93fd-b4b13242e0b6/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047309 May 19 13:40:53.998382 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 413/840] 10.222.0.24 () {58 vars in 1301 bytes} [Thu May 19 13:40:53 2022] GET /compute/v2.1/servers/e88cee65-3c7d-43a4-93fd-b4b13242e0b6/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:40:54.154741 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-50022015-2881-43e7-afca-742609689b67 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:40:54.155672 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-50022015-2881-43e7-afca-742609689b67 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [instance: e88cee65-3c7d-43a4-93fd-b4b13242e0b6] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:40:54.168078 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-50022015-2881-43e7-afca-742609689b67 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:40:54.168850 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-50022015-2881-43e7-afca-742609689b67 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:40:54.170971 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-50022015-2881-43e7-afca-742609689b67 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:40:54.171837 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-50022015-2881-43e7-afca-742609689b67 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:40:54.204263 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-50022015-2881-43e7-afca-742609689b67 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "GET /compute/v2.1/servers/e88cee65-3c7d-43a4-93fd-b4b13242e0b6/os-volume_attachments/5b16bf3c-507e-49f0-8f1f-02d3ef73f7a6" status: 200 len: 194 microversion: 2.1 time: 0.057259 May 19 13:40:54.204851 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 428/841] 10.222.0.24 () {58 vars in 1412 bytes} [Thu May 19 13:40:54 2022] GET /compute/v2.1/servers/e88cee65-3c7d-43a4-93fd-b4b13242e0b6/os-volume_attachments/5b16bf3c-507e-49f0-8f1f-02d3ef73f7a6 => generated 194 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:40:54.217217 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-687473af-679a-46bd-b066-151eae0dd143 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:40:54.217733 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-687473af-679a-46bd-b066-151eae0dd143 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [instance: e88cee65-3c7d-43a4-93fd-b4b13242e0b6] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:40:54.224526 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-687473af-679a-46bd-b066-151eae0dd143 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:40:54.225004 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-687473af-679a-46bd-b066-151eae0dd143 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:40:54.225792 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-687473af-679a-46bd-b066-151eae0dd143 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:40:54.226219 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-687473af-679a-46bd-b066-151eae0dd143 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:40:54.309918 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.objects.instance [None req-687473af-679a-46bd-b066-151eae0dd143 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lazy-loading 'services' on Instance uuid e88cee65-3c7d-43a4-93fd-b4b13242e0b6 {{(pid=120472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 13:40:54.401294 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-687473af-679a-46bd-b066-151eae0dd143 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "DELETE /compute/v2.1/servers/e88cee65-3c7d-43a4-93fd-b4b13242e0b6/os-volume_attachments/5b16bf3c-507e-49f0-8f1f-02d3ef73f7a6" status: 202 len: 0 microversion: 2.1 time: 0.187611 May 19 13:40:54.401956 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 414/842] 10.222.0.24 () {58 vars in 1415 bytes} [Thu May 19 13:40:54 2022] DELETE /compute/v2.1/servers/e88cee65-3c7d-43a4-93fd-b4b13242e0b6/os-volume_attachments/5b16bf3c-507e-49f0-8f1f-02d3ef73f7a6 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 13:40:56.590855 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-83c8074a-8029-4a95-9762-dd9a96a1cf37 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:40:56.591510 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-83c8074a-8029-4a95-9762-dd9a96a1cf37 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [instance: e88cee65-3c7d-43a4-93fd-b4b13242e0b6] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:40:56.602717 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-83c8074a-8029-4a95-9762-dd9a96a1cf37 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:40:56.603446 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-83c8074a-8029-4a95-9762-dd9a96a1cf37 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:40:56.604295 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-83c8074a-8029-4a95-9762-dd9a96a1cf37 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:40:56.604994 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-83c8074a-8029-4a95-9762-dd9a96a1cf37 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:40:56.636096 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-83c8074a-8029-4a95-9762-dd9a96a1cf37 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "GET /compute/v2.1/servers/e88cee65-3c7d-43a4-93fd-b4b13242e0b6/os-volume_attachments/414edea7-dfe8-4303-b6f8-8943259e6ab8" status: 200 len: 194 microversion: 2.1 time: 0.051984 May 19 13:40:56.636677 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 429/843] 10.222.0.24 () {58 vars in 1412 bytes} [Thu May 19 13:40:56 2022] GET /compute/v2.1/servers/e88cee65-3c7d-43a4-93fd-b4b13242e0b6/os-volume_attachments/414edea7-dfe8-4303-b6f8-8943259e6ab8 => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:40:56.647868 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-7e433aa0-216d-49a8-a300-a22d2f0c9978 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:40:56.648431 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-7e433aa0-216d-49a8-a300-a22d2f0c9978 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [instance: e88cee65-3c7d-43a4-93fd-b4b13242e0b6] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:40:56.655996 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-7e433aa0-216d-49a8-a300-a22d2f0c9978 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:40:56.656422 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-7e433aa0-216d-49a8-a300-a22d2f0c9978 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:40:56.657591 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-7e433aa0-216d-49a8-a300-a22d2f0c9978 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:40:56.658024 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-7e433aa0-216d-49a8-a300-a22d2f0c9978 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:40:56.759870 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.objects.instance [None req-7e433aa0-216d-49a8-a300-a22d2f0c9978 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lazy-loading 'services' on Instance uuid e88cee65-3c7d-43a4-93fd-b4b13242e0b6 {{(pid=120472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 13:40:56.836655 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-7e433aa0-216d-49a8-a300-a22d2f0c9978 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "DELETE /compute/v2.1/servers/e88cee65-3c7d-43a4-93fd-b4b13242e0b6/os-volume_attachments/414edea7-dfe8-4303-b6f8-8943259e6ab8" status: 202 len: 0 microversion: 2.1 time: 0.193123 May 19 13:40:56.837258 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 415/844] 10.222.0.24 () {58 vars in 1415 bytes} [Thu May 19 13:40:56 2022] DELETE /compute/v2.1/servers/e88cee65-3c7d-43a4-93fd-b4b13242e0b6/os-volume_attachments/414edea7-dfe8-4303-b6f8-8943259e6ab8 => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 13:40:58.012245 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-89176013-fe9a-44cd-96bd-f158a84e2435 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:40:58.013182 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-89176013-fe9a-44cd-96bd-f158a84e2435 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [instance: e88cee65-3c7d-43a4-93fd-b4b13242e0b6] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:40:58.019700 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-89176013-fe9a-44cd-96bd-f158a84e2435 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:40:58.020147 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-89176013-fe9a-44cd-96bd-f158a84e2435 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:40:58.020912 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-89176013-fe9a-44cd-96bd-f158a84e2435 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:40:58.021341 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-89176013-fe9a-44cd-96bd-f158a84e2435 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:40:58.051131 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-89176013-fe9a-44cd-96bd-f158a84e2435 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "GET /compute/v2.1/servers/e88cee65-3c7d-43a4-93fd-b4b13242e0b6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042941 May 19 13:40:58.051700 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 430/845] 10.222.0.24 () {58 vars in 1301 bytes} [Thu May 19 13:40:58 2022] GET /compute/v2.1/servers/e88cee65-3c7d-43a4-93fd-b4b13242e0b6/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 13:40:58.166511 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-6ecc7d25-d1ae-44b1-80cc-ac8d461722ba tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:40:58.167589 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-6ecc7d25-d1ae-44b1-80cc-ac8d461722ba tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [instance: e88cee65-3c7d-43a4-93fd-b4b13242e0b6] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:40:58.175136 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-6ecc7d25-d1ae-44b1-80cc-ac8d461722ba tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:40:58.175521 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-6ecc7d25-d1ae-44b1-80cc-ac8d461722ba tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:40:58.176288 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-6ecc7d25-d1ae-44b1-80cc-ac8d461722ba tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:40:58.176718 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-6ecc7d25-d1ae-44b1-80cc-ac8d461722ba tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:40:58.205841 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-6ecc7d25-d1ae-44b1-80cc-ac8d461722ba tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "GET /compute/v2.1/servers/e88cee65-3c7d-43a4-93fd-b4b13242e0b6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044314 May 19 13:40:58.206339 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 416/846] 10.222.0.24 () {58 vars in 1301 bytes} [Thu May 19 13:40:58 2022] GET /compute/v2.1/servers/e88cee65-3c7d-43a4-93fd-b4b13242e0b6/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 13:40:58.266877 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-a03e8db0-0f74-4723-bcf0-2566ed03a7e5 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:40:58.267389 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-a03e8db0-0f74-4723-bcf0-2566ed03a7e5 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [instance: e88cee65-3c7d-43a4-93fd-b4b13242e0b6] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:40:58.273636 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-a03e8db0-0f74-4723-bcf0-2566ed03a7e5 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:40:58.274091 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-a03e8db0-0f74-4723-bcf0-2566ed03a7e5 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:40:58.274848 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-a03e8db0-0f74-4723-bcf0-2566ed03a7e5 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:40:58.275296 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-a03e8db0-0f74-4723-bcf0-2566ed03a7e5 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:40:58.306899 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-a03e8db0-0f74-4723-bcf0-2566ed03a7e5 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [instance: e88cee65-3c7d-43a4-93fd-b4b13242e0b6] Going to try to terminate instance {{(pid=120471) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 13:40:58.389337 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-a03e8db0-0f74-4723-bcf0-2566ed03a7e5 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "DELETE /compute/v2.1/servers/e88cee65-3c7d-43a4-93fd-b4b13242e0b6" status: 204 len: 0 microversion: 2.1 time: 0.126431 May 19 13:40:58.390016 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 431/847] 10.222.0.24 () {58 vars in 1238 bytes} [Thu May 19 13:40:58 2022] DELETE /compute/v2.1/servers/e88cee65-3c7d-43a4-93fd-b4b13242e0b6 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 13:40:58.399792 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-89172e4e-c763-4bb4-b93f-774e73f23c68 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:40:58.400405 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-89172e4e-c763-4bb4-b93f-774e73f23c68 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [instance: e88cee65-3c7d-43a4-93fd-b4b13242e0b6] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:40:58.406717 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-89172e4e-c763-4bb4-b93f-774e73f23c68 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:40:58.407167 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-89172e4e-c763-4bb4-b93f-774e73f23c68 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:40:58.407920 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-89172e4e-c763-4bb4-b93f-774e73f23c68 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:40:58.408348 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-89172e4e-c763-4bb4-b93f-774e73f23c68 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:40:58.545195 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-89172e4e-c763-4bb4-b93f-774e73f23c68 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883da006d3f4aec8805c74cf5ffae86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1222038740244f69a977fe658d9bfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:40:58.554266 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-89172e4e-c763-4bb4-b93f-774e73f23c68 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "GET /compute/v2.1/servers/e88cee65-3c7d-43a4-93fd-b4b13242e0b6" status: 200 len: 1671 microversion: 2.1 time: 0.158435 May 19 13:40:58.554808 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 417/848] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:40:58 2022] GET /compute/v2.1/servers/e88cee65-3c7d-43a4-93fd-b4b13242e0b6 => generated 1671 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:40:59.578165 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-1b941468-9c5a-4335-a749-54bb0e44a836 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:40:59.579759 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-1b941468-9c5a-4335-a749-54bb0e44a836 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [instance: e88cee65-3c7d-43a4-93fd-b4b13242e0b6] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:40:59.586994 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-1b941468-9c5a-4335-a749-54bb0e44a836 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:40:59.587442 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-1b941468-9c5a-4335-a749-54bb0e44a836 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:40:59.588203 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-1b941468-9c5a-4335-a749-54bb0e44a836 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:40:59.588639 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-1b941468-9c5a-4335-a749-54bb0e44a836 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:40:59.736888 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-1b941468-9c5a-4335-a749-54bb0e44a836 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883da006d3f4aec8805c74cf5ffae86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1222038740244f69a977fe658d9bfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:40:59.749361 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-1b941468-9c5a-4335-a749-54bb0e44a836 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "GET /compute/v2.1/servers/e88cee65-3c7d-43a4-93fd-b4b13242e0b6" status: 200 len: 1671 microversion: 2.1 time: 0.178176 May 19 13:40:59.750299 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 432/849] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:40:59 2022] GET /compute/v2.1/servers/e88cee65-3c7d-43a4-93fd-b4b13242e0b6 => generated 1671 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:41:00.772566 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-475b3746-17d9-4bfd-ae84-076ad0fd4cf8 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:41:00.773180 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-475b3746-17d9-4bfd-ae84-076ad0fd4cf8 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [instance: e88cee65-3c7d-43a4-93fd-b4b13242e0b6] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:41:00.780275 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-475b3746-17d9-4bfd-ae84-076ad0fd4cf8 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:41:00.780764 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-475b3746-17d9-4bfd-ae84-076ad0fd4cf8 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:41:00.781865 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-475b3746-17d9-4bfd-ae84-076ad0fd4cf8 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:41:00.782287 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-475b3746-17d9-4bfd-ae84-076ad0fd4cf8 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:41:00.861859 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-475b3746-17d9-4bfd-ae84-076ad0fd4cf8 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6883da006d3f4aec8805c74cf5ffae86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1222038740244f69a977fe658d9bfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:41:00.869641 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-475b3746-17d9-4bfd-ae84-076ad0fd4cf8 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "GET /compute/v2.1/servers/e88cee65-3c7d-43a4-93fd-b4b13242e0b6" status: 200 len: 1603 microversion: 2.1 time: 0.100924 May 19 13:41:00.870222 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 418/850] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:41:00 2022] GET /compute/v2.1/servers/e88cee65-3c7d-43a4-93fd-b4b13242e0b6 => generated 1603 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:41:01.104257 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [req-c896e4a0-ac93-4390-9777-dd49b306c4e8 req-c324bc8c-fcd4-4f0b-a78a-7dd9ac3d202a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e88cee65-3c7d-43a4-93fd-b4b13242e0b6", "name": "network-vif-deleted", "tag": "e8c2fd0a-e98c-4402-9f10-a546495679c3"}]} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:41:01.119216 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-c896e4a0-ac93-4390-9777-dd49b306c4e8 req-c324bc8c-fcd4-4f0b-a78a-7dd9ac3d202a service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:41:01.119734 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-c896e4a0-ac93-4390-9777-dd49b306c4e8 req-c324bc8c-fcd4-4f0b-a78a-7dd9ac3d202a service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:41:01.132420 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.compute.server_external_events [req-c896e4a0-ac93-4390-9777-dd49b306c4e8 req-c324bc8c-fcd4-4f0b-a78a-7dd9ac3d202a service nova] Creating event network-vif-deleted:e8c2fd0a-e98c-4402-9f10-a546495679c3 for instance e88cee65-3c7d-43a4-93fd-b4b13242e0b6 on hv-cinder-84112 May 19 13:41:01.138679 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [req-c896e4a0-ac93-4390-9777-dd49b306c4e8 req-c324bc8c-fcd4-4f0b-a78a-7dd9ac3d202a service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038147 May 19 13:41:01.139348 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 433/851] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:41:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:41:01.889078 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-fd38179d-a43c-4bfb-9d3f-54d2ceceb5c0 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:41:01.889887 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-fd38179d-a43c-4bfb-9d3f-54d2ceceb5c0 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [instance: e88cee65-3c7d-43a4-93fd-b4b13242e0b6] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:41:01.898107 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-fd38179d-a43c-4bfb-9d3f-54d2ceceb5c0 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:41:01.898569 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-fd38179d-a43c-4bfb-9d3f-54d2ceceb5c0 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:41:01.899364 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-fd38179d-a43c-4bfb-9d3f-54d2ceceb5c0 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:41:01.899796 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-fd38179d-a43c-4bfb-9d3f-54d2ceceb5c0 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:41:01.915264 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.wsgi [None req-fd38179d-a43c-4bfb-9d3f-54d2ceceb5c0 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] HTTP exception thrown: Instance e88cee65-3c7d-43a4-93fd-b4b13242e0b6 could not be found. May 19 13:41:01.916947 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-fd38179d-a43c-4bfb-9d3f-54d2ceceb5c0 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Request method failure captured: May 19 13:41:01.916947 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: request: GET /compute/v2.1/servers/e88cee65-3c7d-43a4-93fd-b4b13242e0b6 HTTP/1.1 May 19 13:41:01.916947 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Accept: application/json May 19 13:41:01.916947 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Accept-Encoding: identity May 19 13:41:01.916947 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Connection: close May 19 13:41:01.916947 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Content-Length: 0 May 19 13:41:01.916947 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Content-Type: application/json May 19 13:41:01.916947 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Host: 10.222.0.24 May 19 13:41:01.916947 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Openstack-System-Scope: None May 19 13:41:01.916947 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: User-Agent: python-urllib3/1.26.9 May 19 13:41:01.916947 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Auth-Token: gAAAAABihkf3L-05oVTPApCTAuaqZzO4Z_IkS_QBTvRRvPxPUB_gSjd3CBVB-b8VW3Of7Eth8Y5ScY7TtKaQgNpKd1FujsmOFefKf1obNg_P9EG6NP2PVObAvAhXLopnkleR4yM-i_Lb1b-iEGstYj3eSw2p_uMBEOtuV6E51Q3WCT9cXS5YR5c May 19 13:41:01.916947 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Domain-Id: None May 19 13:41:01.916947 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Domain-Name: None May 19 13:41:01.916947 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Identity-Status: Confirmed May 19 13:41:01.916947 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Is-Admin-Project: True May 19 13:41:01.916947 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Domain-Id: default May 19 13:41:01.916947 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Domain-Name: Default May 19 13:41:01.916947 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Id: b1222038740244f69a977fe658d9bfe0 May 19 13:41:01.916947 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Name: tempest-AttachVolumeTestJSON-975255197 May 19 13:41:01.916947 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Role: reader,member May 19 13:41:01.916947 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Roles: reader,member May 19 13:41:01.918466 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/b1222038740244f69a977fe658d9bfe0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/b1222038740244f69a977fe658d9bfe0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_b1222038740244f69a977fe658d9bfe0", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/b1222038740244f69a977fe658d9bfe0"}]}] May 19 13:41:01.918466 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant: tempest-AttachVolumeTestJSON-975255197 May 19 13:41:01.918466 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant-Id: b1222038740244f69a977fe658d9bfe0 May 19 13:41:01.918466 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant-Name: tempest-AttachVolumeTestJSON-975255197 May 19 13:41:01.918466 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User: tempest-AttachVolumeTestJSON-975255197-project May 19 13:41:01.918466 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Domain-Id: default May 19 13:41:01.918466 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Domain-Name: Default May 19 13:41:01.918466 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Id: 6883da006d3f4aec8805c74cf5ffae86 May 19 13:41:01.918466 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Name: tempest-AttachVolumeTestJSON-975255197-project May 19 13:41:01.918466 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: method: > May 19 13:41:01.918466 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: exception: Instance e88cee65-3c7d-43a4-93fd-b4b13242e0b6 could not be found. May 19 13:41:01.918466 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: action_args: {'id': 'e88cee65-3c7d-43a4-93fd-b4b13242e0b6'} May 19 13:41:01.919873 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:41:01.919873 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:41:01.919873 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 13:41:01.919873 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 13:41:01.919873 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 13:41:01.919873 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 13:41:01.919873 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 13:41:01.919873 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 13:41:01.919873 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 13:41:01.919873 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 13:41:01.919873 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e88cee65-3c7d-43a4-93fd-b4b13242e0b6 could not be found. May 19 13:41:01.919873 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:41:01.919873 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:41:01.919873 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:41:01.919873 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:41:01.919873 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:41:01.919873 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:41:01.919873 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:41:01.919873 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:41:01.919873 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:41:01.921381 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:41:01.921381 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 13:41:01.921381 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 13:41:01.921381 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 13:41:01.921381 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 13:41:01.921381 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 13:41:01.921381 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 13:41:01.921381 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e88cee65-3c7d-43a4-93fd-b4b13242e0b6 could not be found. May 19 13:41:01.921381 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:41:01.921381 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:41:01.921381 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:41:01.921381 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:41:01.921381 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:41:01.921381 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:41:01.921381 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:41:01.921381 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:41:01.921381 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e88cee65-3c7d-43a4-93fd-b4b13242e0b6 could not be found. May 19 13:41:01.921381 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:41:01.922960 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-fd38179d-a43c-4bfb-9d3f-54d2ceceb5c0 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Returning 404 to user: Instance e88cee65-3c7d-43a4-93fd-b4b13242e0b6 could not be found. {{(pid=120472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:41:01.922960 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-fd38179d-a43c-4bfb-9d3f-54d2ceceb5c0 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "GET /compute/v2.1/servers/e88cee65-3c7d-43a4-93fd-b4b13242e0b6" status: 404 len: 111 microversion: 2.1 time: 0.033870 May 19 13:41:01.922960 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 419/852] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:41:01 2022] GET /compute/v2.1/servers/e88cee65-3c7d-43a4-93fd-b4b13242e0b6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 13:41:01.928989 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-e5d9796e-d697-46e2-ba9f-75b12e4c021a tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Calling method '.version_select at 0x7f7c2a55a790>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:41:01.949297 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-e5d9796e-d697-46e2-ba9f-75b12e4c021a tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-305984050" status: 202 len: 0 microversion: 2.1 time: 0.024534 May 19 13:41:01.949981 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 434/853] 10.222.0.24 () {58 vars in 1217 bytes} [Thu May 19 13:41:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-305984050 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 13:41:04.931597 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-82a02d5b-b239-4520-8b90-7090c28e2830 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:41:04.932148 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-82a02d5b-b239-4520-8b90-7090c28e2830 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [instance: e88cee65-3c7d-43a4-93fd-b4b13242e0b6] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:41:04.939715 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-82a02d5b-b239-4520-8b90-7090c28e2830 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:41:04.940175 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-82a02d5b-b239-4520-8b90-7090c28e2830 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:41:04.940971 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-82a02d5b-b239-4520-8b90-7090c28e2830 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:41:04.941379 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-82a02d5b-b239-4520-8b90-7090c28e2830 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:41:04.956664 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.wsgi [None req-82a02d5b-b239-4520-8b90-7090c28e2830 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] HTTP exception thrown: Instance e88cee65-3c7d-43a4-93fd-b4b13242e0b6 could not be found. May 19 13:41:04.958235 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-82a02d5b-b239-4520-8b90-7090c28e2830 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Request method failure captured: May 19 13:41:04.958235 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: request: DELETE /compute/v2.1/servers/e88cee65-3c7d-43a4-93fd-b4b13242e0b6 HTTP/1.1 May 19 13:41:04.958235 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Accept: application/json May 19 13:41:04.958235 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Accept-Encoding: identity May 19 13:41:04.958235 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Connection: close May 19 13:41:04.958235 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Content-Length: 0 May 19 13:41:04.958235 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Content-Type: application/json May 19 13:41:04.958235 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Host: 10.222.0.24 May 19 13:41:04.958235 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Openstack-System-Scope: None May 19 13:41:04.958235 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: User-Agent: python-urllib3/1.26.9 May 19 13:41:04.958235 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Auth-Token: gAAAAABihkf3L-05oVTPApCTAuaqZzO4Z_IkS_QBTvRRvPxPUB_gSjd3CBVB-b8VW3Of7Eth8Y5ScY7TtKaQgNpKd1FujsmOFefKf1obNg_P9EG6NP2PVObAvAhXLopnkleR4yM-i_Lb1b-iEGstYj3eSw2p_uMBEOtuV6E51Q3WCT9cXS5YR5c May 19 13:41:04.958235 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Domain-Id: None May 19 13:41:04.958235 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Domain-Name: None May 19 13:41:04.958235 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Identity-Status: Confirmed May 19 13:41:04.958235 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Is-Admin-Project: True May 19 13:41:04.958235 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Domain-Id: default May 19 13:41:04.958235 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Domain-Name: Default May 19 13:41:04.958235 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Id: b1222038740244f69a977fe658d9bfe0 May 19 13:41:04.958235 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Name: tempest-AttachVolumeTestJSON-975255197 May 19 13:41:04.958235 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Role: reader,member May 19 13:41:04.958235 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Roles: reader,member May 19 13:41:04.959792 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/b1222038740244f69a977fe658d9bfe0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/b1222038740244f69a977fe658d9bfe0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_b1222038740244f69a977fe658d9bfe0", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/b1222038740244f69a977fe658d9bfe0"}]}] May 19 13:41:04.959792 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant: tempest-AttachVolumeTestJSON-975255197 May 19 13:41:04.959792 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant-Id: b1222038740244f69a977fe658d9bfe0 May 19 13:41:04.959792 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant-Name: tempest-AttachVolumeTestJSON-975255197 May 19 13:41:04.959792 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User: tempest-AttachVolumeTestJSON-975255197-project May 19 13:41:04.959792 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Domain-Id: default May 19 13:41:04.959792 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Domain-Name: Default May 19 13:41:04.959792 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Id: 6883da006d3f4aec8805c74cf5ffae86 May 19 13:41:04.959792 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Name: tempest-AttachVolumeTestJSON-975255197-project May 19 13:41:04.959792 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: method: > May 19 13:41:04.959792 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: exception: Instance e88cee65-3c7d-43a4-93fd-b4b13242e0b6 could not be found. May 19 13:41:04.959792 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: action_args: {'id': 'e88cee65-3c7d-43a4-93fd-b4b13242e0b6'} May 19 13:41:04.963487 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:41:04.963487 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:41:04.963487 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 13:41:04.963487 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 13:41:04.963487 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 13:41:04.963487 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 13:41:04.963487 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 13:41:04.963487 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 13:41:04.963487 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 13:41:04.963487 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 13:41:04.963487 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e88cee65-3c7d-43a4-93fd-b4b13242e0b6 could not be found. May 19 13:41:04.963487 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:41:04.963487 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:41:04.963487 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:41:04.963487 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:41:04.963487 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:41:04.963487 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:41:04.963487 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:41:04.963487 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:41:04.963487 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:41:04.965088 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:41:04.965088 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 13:41:04.965088 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 13:41:04.965088 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 13:41:04.965088 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 13:41:04.965088 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 13:41:04.965088 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 13:41:04.965088 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 13:41:04.965088 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 13:41:04.965088 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e88cee65-3c7d-43a4-93fd-b4b13242e0b6 could not be found. May 19 13:41:04.965088 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:41:04.965088 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:41:04.965088 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:41:04.965088 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:41:04.965088 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:41:04.965088 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:41:04.965088 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:41:04.965088 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:41:04.965088 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e88cee65-3c7d-43a4-93fd-b4b13242e0b6 could not be found. May 19 13:41:04.965088 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:41:04.966710 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-82a02d5b-b239-4520-8b90-7090c28e2830 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Returning 404 to user: Instance e88cee65-3c7d-43a4-93fd-b4b13242e0b6 could not be found. {{(pid=120472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:41:04.966710 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-82a02d5b-b239-4520-8b90-7090c28e2830 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "DELETE /compute/v2.1/servers/e88cee65-3c7d-43a4-93fd-b4b13242e0b6" status: 404 len: 111 microversion: 2.1 time: 0.032130 May 19 13:41:04.966710 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 420/854] 10.222.0.24 () {58 vars in 1238 bytes} [Thu May 19 13:41:04 2022] DELETE /compute/v2.1/servers/e88cee65-3c7d-43a4-93fd-b4b13242e0b6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 13:41:04.968289 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-38e7a948-6597-4425-99dc-627838d0de28 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:41:04.969044 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-38e7a948-6597-4425-99dc-627838d0de28 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [instance: e88cee65-3c7d-43a4-93fd-b4b13242e0b6] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:41:04.976251 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-38e7a948-6597-4425-99dc-627838d0de28 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:41:04.976739 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-38e7a948-6597-4425-99dc-627838d0de28 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:41:04.977524 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-38e7a948-6597-4425-99dc-627838d0de28 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:41:04.977956 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-38e7a948-6597-4425-99dc-627838d0de28 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:41:04.991926 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.wsgi [None req-38e7a948-6597-4425-99dc-627838d0de28 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] HTTP exception thrown: Instance e88cee65-3c7d-43a4-93fd-b4b13242e0b6 could not be found. May 19 13:41:04.993578 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-38e7a948-6597-4425-99dc-627838d0de28 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Request method failure captured: May 19 13:41:04.993578 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: request: GET /compute/v2.1/servers/e88cee65-3c7d-43a4-93fd-b4b13242e0b6 HTTP/1.1 May 19 13:41:04.993578 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Accept: application/json May 19 13:41:04.993578 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Accept-Encoding: identity May 19 13:41:04.993578 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Connection: close May 19 13:41:04.993578 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Content-Length: 0 May 19 13:41:04.993578 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Content-Type: application/json May 19 13:41:04.993578 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Host: 10.222.0.24 May 19 13:41:04.993578 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Openstack-System-Scope: None May 19 13:41:04.993578 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: User-Agent: python-urllib3/1.26.9 May 19 13:41:04.993578 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Auth-Token: gAAAAABihkf3L-05oVTPApCTAuaqZzO4Z_IkS_QBTvRRvPxPUB_gSjd3CBVB-b8VW3Of7Eth8Y5ScY7TtKaQgNpKd1FujsmOFefKf1obNg_P9EG6NP2PVObAvAhXLopnkleR4yM-i_Lb1b-iEGstYj3eSw2p_uMBEOtuV6E51Q3WCT9cXS5YR5c May 19 13:41:04.993578 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Domain-Id: None May 19 13:41:04.993578 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Domain-Name: None May 19 13:41:04.993578 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Identity-Status: Confirmed May 19 13:41:04.993578 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Is-Admin-Project: True May 19 13:41:04.993578 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Domain-Id: default May 19 13:41:04.993578 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Domain-Name: Default May 19 13:41:04.993578 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Id: b1222038740244f69a977fe658d9bfe0 May 19 13:41:04.993578 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Name: tempest-AttachVolumeTestJSON-975255197 May 19 13:41:04.993578 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Role: reader,member May 19 13:41:04.993578 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Roles: reader,member May 19 13:41:04.995332 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/b1222038740244f69a977fe658d9bfe0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/b1222038740244f69a977fe658d9bfe0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_b1222038740244f69a977fe658d9bfe0", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/b1222038740244f69a977fe658d9bfe0"}]}] May 19 13:41:04.995332 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Tenant: tempest-AttachVolumeTestJSON-975255197 May 19 13:41:04.995332 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Tenant-Id: b1222038740244f69a977fe658d9bfe0 May 19 13:41:04.995332 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Tenant-Name: tempest-AttachVolumeTestJSON-975255197 May 19 13:41:04.995332 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User: tempest-AttachVolumeTestJSON-975255197-project May 19 13:41:04.995332 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Domain-Id: default May 19 13:41:04.995332 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Domain-Name: Default May 19 13:41:04.995332 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Id: 6883da006d3f4aec8805c74cf5ffae86 May 19 13:41:04.995332 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Name: tempest-AttachVolumeTestJSON-975255197-project May 19 13:41:04.995332 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: method: > May 19 13:41:04.995332 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: exception: Instance e88cee65-3c7d-43a4-93fd-b4b13242e0b6 could not be found. May 19 13:41:04.995332 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: action_args: {'id': 'e88cee65-3c7d-43a4-93fd-b4b13242e0b6'} May 19 13:41:04.998837 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:41:04.998837 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:41:04.998837 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 13:41:04.998837 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 13:41:04.998837 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 13:41:04.998837 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 13:41:04.998837 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 13:41:04.998837 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 13:41:04.998837 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 13:41:04.998837 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 13:41:04.998837 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e88cee65-3c7d-43a4-93fd-b4b13242e0b6 could not be found. May 19 13:41:04.998837 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:41:04.998837 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:41:04.998837 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:41:04.998837 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:41:04.998837 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:41:04.998837 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:41:04.998837 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:41:04.998837 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:41:04.998837 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:41:05.000348 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:41:05.000348 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 13:41:05.000348 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 13:41:05.000348 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 13:41:05.000348 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 13:41:05.000348 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 13:41:05.000348 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 13:41:05.000348 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e88cee65-3c7d-43a4-93fd-b4b13242e0b6 could not be found. May 19 13:41:05.000348 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:41:05.000348 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:41:05.000348 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:41:05.000348 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:41:05.000348 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:41:05.000348 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:41:05.000348 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:41:05.000348 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:41:05.000348 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e88cee65-3c7d-43a4-93fd-b4b13242e0b6 could not be found. May 19 13:41:05.000348 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:41:05.002087 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-38e7a948-6597-4425-99dc-627838d0de28 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Returning 404 to user: Instance e88cee65-3c7d-43a4-93fd-b4b13242e0b6 could not be found. {{(pid=120471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:41:05.002087 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-38e7a948-6597-4425-99dc-627838d0de28 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "GET /compute/v2.1/servers/e88cee65-3c7d-43a4-93fd-b4b13242e0b6" status: 404 len: 111 microversion: 2.1 time: 0.030655 May 19 13:41:05.002087 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 435/855] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:41:04 2022] GET /compute/v2.1/servers/e88cee65-3c7d-43a4-93fd-b4b13242e0b6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 13:41:06.171428 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-2a20e40c-0876-4d94-99dc-49bf2c15ba7a tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:41:06.171951 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-2a20e40c-0876-4d94-99dc-49bf2c15ba7a tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [instance: 5b705092-099b-444c-81cf-ecfacd701ac1] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:41:06.182463 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-2a20e40c-0876-4d94-99dc-49bf2c15ba7a tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:41:06.183075 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-2a20e40c-0876-4d94-99dc-49bf2c15ba7a tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:41:06.184214 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-2a20e40c-0876-4d94-99dc-49bf2c15ba7a tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:41:06.184852 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-2a20e40c-0876-4d94-99dc-49bf2c15ba7a tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:41:06.201060 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.wsgi [None req-2a20e40c-0876-4d94-99dc-49bf2c15ba7a tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] HTTP exception thrown: Instance 5b705092-099b-444c-81cf-ecfacd701ac1 could not be found. May 19 13:41:06.202665 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-2a20e40c-0876-4d94-99dc-49bf2c15ba7a tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Request method failure captured: May 19 13:41:06.202665 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: request: DELETE /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1 HTTP/1.1 May 19 13:41:06.202665 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Accept: application/json May 19 13:41:06.202665 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Accept-Encoding: identity May 19 13:41:06.202665 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Connection: close May 19 13:41:06.202665 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Content-Length: 0 May 19 13:41:06.202665 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Content-Type: application/json May 19 13:41:06.202665 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Host: 10.222.0.24 May 19 13:41:06.202665 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Openstack-System-Scope: None May 19 13:41:06.202665 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: User-Agent: python-urllib3/1.26.9 May 19 13:41:06.202665 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Auth-Token: gAAAAABihkf3L-05oVTPApCTAuaqZzO4Z_IkS_QBTvRRvPxPUB_gSjd3CBVB-b8VW3Of7Eth8Y5ScY7TtKaQgNpKd1FujsmOFefKf1obNg_P9EG6NP2PVObAvAhXLopnkleR4yM-i_Lb1b-iEGstYj3eSw2p_uMBEOtuV6E51Q3WCT9cXS5YR5c May 19 13:41:06.202665 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Domain-Id: None May 19 13:41:06.202665 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Domain-Name: None May 19 13:41:06.202665 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Identity-Status: Confirmed May 19 13:41:06.202665 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Is-Admin-Project: True May 19 13:41:06.202665 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Domain-Id: default May 19 13:41:06.202665 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Domain-Name: Default May 19 13:41:06.202665 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Id: b1222038740244f69a977fe658d9bfe0 May 19 13:41:06.202665 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Name: tempest-AttachVolumeTestJSON-975255197 May 19 13:41:06.202665 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Role: reader,member May 19 13:41:06.202665 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Roles: reader,member May 19 13:41:06.204306 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/b1222038740244f69a977fe658d9bfe0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/b1222038740244f69a977fe658d9bfe0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_b1222038740244f69a977fe658d9bfe0", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/b1222038740244f69a977fe658d9bfe0"}]}] May 19 13:41:06.204306 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant: tempest-AttachVolumeTestJSON-975255197 May 19 13:41:06.204306 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant-Id: b1222038740244f69a977fe658d9bfe0 May 19 13:41:06.204306 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant-Name: tempest-AttachVolumeTestJSON-975255197 May 19 13:41:06.204306 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User: tempest-AttachVolumeTestJSON-975255197-project May 19 13:41:06.204306 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Domain-Id: default May 19 13:41:06.204306 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Domain-Name: Default May 19 13:41:06.204306 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Id: 6883da006d3f4aec8805c74cf5ffae86 May 19 13:41:06.204306 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Name: tempest-AttachVolumeTestJSON-975255197-project May 19 13:41:06.204306 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: method: > May 19 13:41:06.204306 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: exception: Instance 5b705092-099b-444c-81cf-ecfacd701ac1 could not be found. May 19 13:41:06.204306 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: action_args: {'id': '5b705092-099b-444c-81cf-ecfacd701ac1'} May 19 13:41:06.205372 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:41:06.205372 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:41:06.205372 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 13:41:06.205372 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 13:41:06.205372 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 13:41:06.205372 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 13:41:06.205372 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 13:41:06.205372 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 13:41:06.205372 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 13:41:06.205372 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 13:41:06.205372 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b705092-099b-444c-81cf-ecfacd701ac1 could not be found. May 19 13:41:06.205372 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:41:06.205372 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:41:06.205372 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:41:06.205372 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:41:06.205372 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:41:06.205372 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:41:06.205372 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:41:06.205372 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:41:06.205372 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:41:06.207223 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:41:06.207223 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 13:41:06.207223 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 13:41:06.207223 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 13:41:06.207223 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 13:41:06.207223 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 13:41:06.207223 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 13:41:06.207223 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 13:41:06.207223 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 13:41:06.207223 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b705092-099b-444c-81cf-ecfacd701ac1 could not be found. May 19 13:41:06.207223 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:41:06.207223 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:41:06.207223 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:41:06.207223 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:41:06.207223 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:41:06.207223 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:41:06.207223 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:41:06.207223 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:41:06.207223 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b705092-099b-444c-81cf-ecfacd701ac1 could not be found. May 19 13:41:06.207223 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:41:06.208857 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-2a20e40c-0876-4d94-99dc-49bf2c15ba7a tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Returning 404 to user: Instance 5b705092-099b-444c-81cf-ecfacd701ac1 could not be found. {{(pid=120472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:41:06.208857 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-2a20e40c-0876-4d94-99dc-49bf2c15ba7a tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "DELETE /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1" status: 404 len: 111 microversion: 2.1 time: 0.038646 May 19 13:41:06.208857 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 421/856] 10.222.0.24 () {58 vars in 1238 bytes} [Thu May 19 13:41:06 2022] DELETE /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 13:41:06.214153 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-16db958f-5981-44b0-a836-993e62915e40 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:41:06.214756 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-16db958f-5981-44b0-a836-993e62915e40 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] [instance: 5b705092-099b-444c-81cf-ecfacd701ac1] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:41:06.217156 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:41:06.222982 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-16db958f-5981-44b0-a836-993e62915e40 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:41:06.223415 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-16db958f-5981-44b0-a836-993e62915e40 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:41:06.224194 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-16db958f-5981-44b0-a836-993e62915e40 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:41:06.224616 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-16db958f-5981-44b0-a836-993e62915e40 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:41:06.227881 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:41:06.241676 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.wsgi [None req-16db958f-5981-44b0-a836-993e62915e40 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] HTTP exception thrown: Instance 5b705092-099b-444c-81cf-ecfacd701ac1 could not be found. May 19 13:41:06.243207 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-16db958f-5981-44b0-a836-993e62915e40 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Request method failure captured: May 19 13:41:06.243207 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: request: GET /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1 HTTP/1.1 May 19 13:41:06.243207 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Accept: application/json May 19 13:41:06.243207 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Accept-Encoding: identity May 19 13:41:06.243207 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Connection: close May 19 13:41:06.243207 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Content-Length: 0 May 19 13:41:06.243207 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Content-Type: application/json May 19 13:41:06.243207 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Host: 10.222.0.24 May 19 13:41:06.243207 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Openstack-System-Scope: None May 19 13:41:06.243207 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: User-Agent: python-urllib3/1.26.9 May 19 13:41:06.243207 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Auth-Token: gAAAAABihkf3L-05oVTPApCTAuaqZzO4Z_IkS_QBTvRRvPxPUB_gSjd3CBVB-b8VW3Of7Eth8Y5ScY7TtKaQgNpKd1FujsmOFefKf1obNg_P9EG6NP2PVObAvAhXLopnkleR4yM-i_Lb1b-iEGstYj3eSw2p_uMBEOtuV6E51Q3WCT9cXS5YR5c May 19 13:41:06.243207 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Domain-Id: None May 19 13:41:06.243207 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Domain-Name: None May 19 13:41:06.243207 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Identity-Status: Confirmed May 19 13:41:06.243207 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Is-Admin-Project: True May 19 13:41:06.243207 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Domain-Id: default May 19 13:41:06.243207 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Domain-Name: Default May 19 13:41:06.243207 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Id: b1222038740244f69a977fe658d9bfe0 May 19 13:41:06.243207 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Name: tempest-AttachVolumeTestJSON-975255197 May 19 13:41:06.243207 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Role: reader,member May 19 13:41:06.243207 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Roles: reader,member May 19 13:41:06.244648 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/b1222038740244f69a977fe658d9bfe0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/b1222038740244f69a977fe658d9bfe0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_b1222038740244f69a977fe658d9bfe0", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/b1222038740244f69a977fe658d9bfe0"}]}] May 19 13:41:06.244648 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Tenant: tempest-AttachVolumeTestJSON-975255197 May 19 13:41:06.244648 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Tenant-Id: b1222038740244f69a977fe658d9bfe0 May 19 13:41:06.244648 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Tenant-Name: tempest-AttachVolumeTestJSON-975255197 May 19 13:41:06.244648 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User: tempest-AttachVolumeTestJSON-975255197-project May 19 13:41:06.244648 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Domain-Id: default May 19 13:41:06.244648 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Domain-Name: Default May 19 13:41:06.244648 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Id: 6883da006d3f4aec8805c74cf5ffae86 May 19 13:41:06.244648 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Name: tempest-AttachVolumeTestJSON-975255197-project May 19 13:41:06.244648 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: method: > May 19 13:41:06.244648 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: exception: Instance 5b705092-099b-444c-81cf-ecfacd701ac1 could not be found. May 19 13:41:06.244648 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: action_args: {'id': '5b705092-099b-444c-81cf-ecfacd701ac1'} May 19 13:41:06.245618 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:41:06.245618 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:41:06.245618 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 13:41:06.245618 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 13:41:06.245618 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 13:41:06.245618 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 13:41:06.245618 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 13:41:06.245618 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 13:41:06.245618 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 13:41:06.245618 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 13:41:06.245618 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b705092-099b-444c-81cf-ecfacd701ac1 could not be found. May 19 13:41:06.245618 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:41:06.245618 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:41:06.245618 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:41:06.245618 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:41:06.245618 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:41:06.245618 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:41:06.245618 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:41:06.245618 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:41:06.245618 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:41:06.247128 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:41:06.247128 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 13:41:06.247128 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 13:41:06.247128 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 13:41:06.247128 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 13:41:06.247128 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 13:41:06.247128 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 13:41:06.247128 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b705092-099b-444c-81cf-ecfacd701ac1 could not be found. May 19 13:41:06.247128 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:41:06.247128 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:41:06.247128 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:41:06.247128 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:41:06.247128 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:41:06.247128 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:41:06.247128 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:41:06.247128 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:41:06.247128 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b705092-099b-444c-81cf-ecfacd701ac1 could not be found. May 19 13:41:06.247128 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:41:06.248487 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-16db958f-5981-44b0-a836-993e62915e40 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] Returning 404 to user: Instance 5b705092-099b-444c-81cf-ecfacd701ac1 could not be found. {{(pid=120471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:41:06.248487 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-16db958f-5981-44b0-a836-993e62915e40 tempest-AttachVolumeTestJSON-975255197 tempest-AttachVolumeTestJSON-975255197-project] 10.222.0.24 "GET /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1" status: 404 len: 111 microversion: 2.1 time: 0.034311 May 19 13:41:06.248487 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 436/857] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:41:06 2022] GET /compute/v2.1/servers/5b705092-099b-444c-81cf-ecfacd701ac1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 13:41:14.427608 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-96f157b5-df4e-4cbf-9a6e-97f839cad507 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-755798590", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1595031897", "security_groups": [{"name": "tempest-secgroup-smoke-1083232826"}], "block_device_mapping_v2": [{"uuid": "28cb5065-e832-41f9-9bfd-31768c45addd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "43f56851-7e12-4789-85bf-4f3ea4d4394d"}]}} {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:41:14.436631 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_api:SELECT=23 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:41:14.621116 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.network.neutron [None req-96f157b5-df4e-4cbf-9a6e-97f839cad507 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] validate_networks() for [('43f56851-7e12-4789-85bf-4f3ea4d4394d', None, None, None, None, None)] {{(pid=120472) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 13:41:15.118304 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-0bbe29d2-b597-4ce9-a22b-2316140c7030 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Action: 'create', calling method: .version_select at 0x7f7c2ae38ee0>, body: {"keypair": {"name": "tempest-keypair-223621523", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGTI9pPV4DjMK04MVjhf1REqQAqmPTLENpCQTQ+qOeOm51adBkRgpJ8cYgUtU0ROtsdoMb2bQGd4a5isTRiqDFlj3lfwttYf6+PCwscIkTiQr6+7Wh/IXpZ5MDYYBheJIQ=="}} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:41:15.128624 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.virt.hardware [None req-96f157b5-df4e-4cbf-9a6e-97f839cad507 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Flavor limits 0:0:0 {{(pid=120472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 13:41:15.129111 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.virt.hardware [None req-96f157b5-df4e-4cbf-9a6e-97f839cad507 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Image limits 0:0:0 {{(pid=120472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 13:41:15.129729 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.virt.hardware [None req-96f157b5-df4e-4cbf-9a6e-97f839cad507 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Flavor pref 0:0:0 {{(pid=120472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 13:41:15.130310 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.virt.hardware [None req-96f157b5-df4e-4cbf-9a6e-97f839cad507 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Image pref 0:0:0 {{(pid=120472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 13:41:15.130797 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.virt.hardware [None req-96f157b5-df4e-4cbf-9a6e-97f839cad507 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 13:41:15.132580 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.quota [None req-0bbe29d2-b597-4ce9-a22b-2316140c7030 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Getting quotas for project bc560e8b75194743bbb46d903b481357. Resources: {'key_pairs'} {{(pid=120471) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 13:41:15.136622 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.quota [None req-0bbe29d2-b597-4ce9-a22b-2316140c7030 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Getting quotas for user daa4a2a39deb4e7ba54032acec14e029 and project bc560e8b75194743bbb46d903b481357. Resources: {'key_pairs'} {{(pid=120471) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 13:41:15.140135 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-96f157b5-df4e-4cbf-9a6e-97f839cad507 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:41:15.140657 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-96f157b5-df4e-4cbf-9a6e-97f839cad507 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:41:15.141555 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-96f157b5-df4e-4cbf-9a6e-97f839cad507 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:41:15.142086 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-96f157b5-df4e-4cbf-9a6e-97f839cad507 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:41:15.147875 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:41:15.159825 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-0bbe29d2-b597-4ce9-a22b-2316140c7030 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.169354 May 19 13:41:15.160553 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 437/858] 10.222.0.24 () {60 vars in 1158 bytes} [Thu May 19 13:41:14 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:41:15.162345 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.quota [None req-96f157b5-df4e-4cbf-9a6e-97f839cad507 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Getting quotas for project 98ad7b921dbc4a8d9e9be0d50385deee. Resources: {'instances', 'cores', 'ram'} {{(pid=120472) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 13:41:15.166949 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.quota [None req-96f157b5-df4e-4cbf-9a6e-97f839cad507 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Getting quotas for user aa0a4b41707d444581ee0aa2296ac0ba and project 98ad7b921dbc4a8d9e9be0d50385deee. Resources: {'instances', 'cores', 'ram'} {{(pid=120472) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 13:41:15.230653 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-96f157b5-df4e-4cbf-9a6e-97f839cad507 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Going to run 1 instances... {{(pid=120472) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 13:41:15.232753 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-96f157b5-df4e-4cbf-9a6e-97f839cad507 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] [instance: 712420e9-2543-45fe-8b45-e46ca934a579] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='28cb5065-e832-41f9-9bfd-31768c45addd',volume_size=None,volume_type=None)] {{(pid=120472) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 13:41:15.367058 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-96f157b5-df4e-4cbf-9a6e-97f839cad507 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.943486 May 19 13:41:15.367698 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 422/859] 10.222.0.24 () {60 vars in 1146 bytes} [Thu May 19 13:41:14 2022] POST /compute/v2.1/servers => generated 406 bytes in 945 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 13:41:15.385388 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-d36f3146-f961-4f55-9c38-a83ea3c8bd6e tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:41:15.386216 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-d36f3146-f961-4f55-9c38-a83ea3c8bd6e tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] [instance: 712420e9-2543-45fe-8b45-e46ca934a579] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:41:15.486204 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-d36f3146-f961-4f55-9c38-a83ea3c8bd6e tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0a4b41707d444581ee0aa2296ac0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ad7b921dbc4a8d9e9be0d50385deee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:41:15.499374 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-d36f3146-f961-4f55-9c38-a83ea3c8bd6e tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] 10.222.0.24 "GET /compute/v2.1/servers/712420e9-2543-45fe-8b45-e46ca934a579" status: 200 len: 1094 microversion: 2.1 time: 0.124705 May 19 13:41:15.500802 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 438/860] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:41:15 2022] GET /compute/v2.1/servers/712420e9-2543-45fe-8b45-e46ca934a579 => generated 1094 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:41:16.518820 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-555927ec-839e-4275-bd3a-229c88abf361 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:41:16.519782 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-555927ec-839e-4275-bd3a-229c88abf361 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] [instance: 712420e9-2543-45fe-8b45-e46ca934a579] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:41:16.529747 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-555927ec-839e-4275-bd3a-229c88abf361 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:41:16.530673 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-555927ec-839e-4275-bd3a-229c88abf361 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:41:16.538834 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-555927ec-839e-4275-bd3a-229c88abf361 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:41:16.539654 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-555927ec-839e-4275-bd3a-229c88abf361 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:41:16.605954 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-3d4134af-1463-4e09-9166-77ab750dbd5e tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-659383921", "imageRef": "9beb860d-9c3f-4244-80aa-71a9c337a429", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "39a38089-655e-4b34-b99f-11a97c39ff7d"}], "security_groups": [{"name": "tempest-securitygroup--1230831070"}], "key_name": "tempest-keypair-223621523", "user_data": "}} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:41:16.638959 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-555927ec-839e-4275-bd3a-229c88abf361 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0a4b41707d444581ee0aa2296ac0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ad7b921dbc4a8d9e9be0d50385deee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:41:16.649105 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-555927ec-839e-4275-bd3a-229c88abf361 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] 10.222.0.24 "GET /compute/v2.1/servers/712420e9-2543-45fe-8b45-e46ca934a579" status: 200 len: 1210 microversion: 2.1 time: 0.134257 May 19 13:41:16.649748 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 423/861] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:41:16 2022] GET /compute/v2.1/servers/712420e9-2543-45fe-8b45-e46ca934a579 => generated 1210 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:41:16.734131 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.network.neutron [None req-3d4134af-1463-4e09-9166-77ab750dbd5e tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] validate_networks() for [('39a38089-655e-4b34-b99f-11a97c39ff7d', None, None, None, None, None)] {{(pid=120471) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 13:41:17.172095 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.virt.hardware [None req-3d4134af-1463-4e09-9166-77ab750dbd5e tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Flavor limits 0:0:0 {{(pid=120471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 13:41:17.172634 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.virt.hardware [None req-3d4134af-1463-4e09-9166-77ab750dbd5e tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Image limits 0:0:0 {{(pid=120471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 13:41:17.173239 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.virt.hardware [None req-3d4134af-1463-4e09-9166-77ab750dbd5e tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Flavor pref 0:0:0 {{(pid=120471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 13:41:17.173855 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.virt.hardware [None req-3d4134af-1463-4e09-9166-77ab750dbd5e tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Image pref 0:0:0 {{(pid=120471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 13:41:17.174503 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.virt.hardware [None req-3d4134af-1463-4e09-9166-77ab750dbd5e tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 13:41:17.186577 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-3d4134af-1463-4e09-9166-77ab750dbd5e tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:41:17.187488 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-3d4134af-1463-4e09-9166-77ab750dbd5e tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:41:17.188584 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-3d4134af-1463-4e09-9166-77ab750dbd5e tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:41:17.189498 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-3d4134af-1463-4e09-9166-77ab750dbd5e tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:41:17.211883 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.quota [None req-3d4134af-1463-4e09-9166-77ab750dbd5e tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Getting quotas for project bc560e8b75194743bbb46d903b481357. Resources: {'instances', 'cores', 'ram'} {{(pid=120471) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 13:41:17.217512 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.quota [None req-3d4134af-1463-4e09-9166-77ab750dbd5e tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Getting quotas for user daa4a2a39deb4e7ba54032acec14e029 and project bc560e8b75194743bbb46d903b481357. Resources: {'instances', 'cores', 'ram'} {{(pid=120471) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 13:41:17.230785 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-3d4134af-1463-4e09-9166-77ab750dbd5e tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Going to run 1 instances... {{(pid=120471) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 13:41:17.233779 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-3d4134af-1463-4e09-9166-77ab750dbd5e tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: fbe881d3-e162-43fb-a5d8-0c954d016ad3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9beb860d-9c3f-4244-80aa-71a9c337a429',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120471) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 13:41:17.335644 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-3d4134af-1463-4e09-9166-77ab750dbd5e tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.736958 May 19 13:41:17.337094 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 439/862] 10.222.0.24 () {60 vars in 1146 bytes} [Thu May 19 13:41:16 2022] POST /compute/v2.1/servers => generated 402 bytes in 739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 19 13:41:17.347129 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-543092f5-1b06-47dc-85d6-d0575a2fdfb6 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:41:17.347780 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-543092f5-1b06-47dc-85d6-d0575a2fdfb6 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: fbe881d3-e162-43fb-a5d8-0c954d016ad3] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:41:17.454266 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-543092f5-1b06-47dc-85d6-d0575a2fdfb6 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa4a2a39deb4e7ba54032acec14e029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc560e8b75194743bbb46d903b481357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:41:17.470833 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-543092f5-1b06-47dc-85d6-d0575a2fdfb6 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "GET /compute/v2.1/servers/fbe881d3-e162-43fb-a5d8-0c954d016ad3" status: 200 len: 1240 microversion: 2.1 time: 0.127461 May 19 13:41:17.478350 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 424/863] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:41:17 2022] GET /compute/v2.1/servers/fbe881d3-e162-43fb-a5d8-0c954d016ad3 => generated 1240 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:41:17.670017 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-90e5fc40-5c58-4be6-9abc-67a3ad575a9a tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:41:17.671580 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-90e5fc40-5c58-4be6-9abc-67a3ad575a9a tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] [instance: 712420e9-2543-45fe-8b45-e46ca934a579] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:41:17.686185 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-90e5fc40-5c58-4be6-9abc-67a3ad575a9a tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:41:17.687337 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-90e5fc40-5c58-4be6-9abc-67a3ad575a9a tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:41:17.688829 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-90e5fc40-5c58-4be6-9abc-67a3ad575a9a tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:41:17.689795 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-90e5fc40-5c58-4be6-9abc-67a3ad575a9a tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:41:17.897748 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-90e5fc40-5c58-4be6-9abc-67a3ad575a9a tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0a4b41707d444581ee0aa2296ac0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ad7b921dbc4a8d9e9be0d50385deee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:41:17.907348 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-90e5fc40-5c58-4be6-9abc-67a3ad575a9a tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] 10.222.0.24 "GET /compute/v2.1/servers/712420e9-2543-45fe-8b45-e46ca934a579" status: 200 len: 1266 microversion: 2.1 time: 0.244918 May 19 13:41:17.929021 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 440/864] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:41:17 2022] GET /compute/v2.1/servers/712420e9-2543-45fe-8b45-e46ca934a579 => generated 1266 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:41:18.491254 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-5cd40e98-1de1-48b2-bfa7-22b77c0b3c3c tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:41:18.491889 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-5cd40e98-1de1-48b2-bfa7-22b77c0b3c3c tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: fbe881d3-e162-43fb-a5d8-0c954d016ad3] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:41:18.500413 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-5cd40e98-1de1-48b2-bfa7-22b77c0b3c3c tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:41:18.500867 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-5cd40e98-1de1-48b2-bfa7-22b77c0b3c3c tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:41:18.500983 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [req-9f754d9c-368b-4f5d-8d5b-1ed4e4a3b63a req-ae2e715a-c88a-4488-bedb-7dc55ede1969 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "712420e9-2543-45fe-8b45-e46ca934a579", "tag": "d0ce9e8c-78f4-482c-b815-588341b22d40"}]} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:41:18.501676 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-5cd40e98-1de1-48b2-bfa7-22b77c0b3c3c tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:41:18.504126 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-5cd40e98-1de1-48b2-bfa7-22b77c0b3c3c tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:41:18.516855 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-9f754d9c-368b-4f5d-8d5b-1ed4e4a3b63a req-ae2e715a-c88a-4488-bedb-7dc55ede1969 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:41:18.520612 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-9f754d9c-368b-4f5d-8d5b-1ed4e4a3b63a req-ae2e715a-c88a-4488-bedb-7dc55ede1969 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:41:18.538040 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.compute.server_external_events [req-9f754d9c-368b-4f5d-8d5b-1ed4e4a3b63a req-ae2e715a-c88a-4488-bedb-7dc55ede1969 service nova] Creating event network-changed:d0ce9e8c-78f4-482c-b815-588341b22d40 for instance 712420e9-2543-45fe-8b45-e46ca934a579 on hv-cinder-84112 May 19 13:41:18.547248 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [req-9f754d9c-368b-4f5d-8d5b-1ed4e4a3b63a req-ae2e715a-c88a-4488-bedb-7dc55ede1969 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049740 May 19 13:41:18.549997 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 441/865] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:41:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:41:18.597844 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-5cd40e98-1de1-48b2-bfa7-22b77c0b3c3c tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa4a2a39deb4e7ba54032acec14e029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc560e8b75194743bbb46d903b481357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:41:18.615186 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-5cd40e98-1de1-48b2-bfa7-22b77c0b3c3c tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "GET /compute/v2.1/servers/fbe881d3-e162-43fb-a5d8-0c954d016ad3" status: 200 len: 1292 microversion: 2.1 time: 0.129653 May 19 13:41:18.616149 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 425/866] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:41:18 2022] GET /compute/v2.1/servers/fbe881d3-e162-43fb-a5d8-0c954d016ad3 => generated 1292 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:41:18.926395 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-a04cfbb1-5c72-4f8a-9896-a4ed8c7de0bb tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:41:18.927902 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-a04cfbb1-5c72-4f8a-9896-a4ed8c7de0bb tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] [instance: 712420e9-2543-45fe-8b45-e46ca934a579] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:41:18.935304 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-a04cfbb1-5c72-4f8a-9896-a4ed8c7de0bb tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:41:18.935949 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-a04cfbb1-5c72-4f8a-9896-a4ed8c7de0bb tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:41:18.936896 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-a04cfbb1-5c72-4f8a-9896-a4ed8c7de0bb tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:41:18.937687 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-a04cfbb1-5c72-4f8a-9896-a4ed8c7de0bb tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:41:19.119348 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-a04cfbb1-5c72-4f8a-9896-a4ed8c7de0bb tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0a4b41707d444581ee0aa2296ac0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ad7b921dbc4a8d9e9be0d50385deee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:41:19.127479 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-a04cfbb1-5c72-4f8a-9896-a4ed8c7de0bb tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] 10.222.0.24 "GET /compute/v2.1/servers/712420e9-2543-45fe-8b45-e46ca934a579" status: 200 len: 1266 microversion: 2.1 time: 0.205848 May 19 13:41:19.133271 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 442/867] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:41:18 2022] GET /compute/v2.1/servers/712420e9-2543-45fe-8b45-e46ca934a579 => generated 1266 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:41:19.633690 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-8a218816-3018-4db6-97b6-3544b4363a71 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:41:19.634517 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-8a218816-3018-4db6-97b6-3544b4363a71 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: fbe881d3-e162-43fb-a5d8-0c954d016ad3] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:41:19.642053 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-8a218816-3018-4db6-97b6-3544b4363a71 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:41:19.642619 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-8a218816-3018-4db6-97b6-3544b4363a71 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:41:19.643573 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-8a218816-3018-4db6-97b6-3544b4363a71 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:41:19.644055 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-8a218816-3018-4db6-97b6-3544b4363a71 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:41:19.784950 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-8a218816-3018-4db6-97b6-3544b4363a71 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa4a2a39deb4e7ba54032acec14e029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc560e8b75194743bbb46d903b481357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:41:19.797397 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-8a218816-3018-4db6-97b6-3544b4363a71 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "GET /compute/v2.1/servers/fbe881d3-e162-43fb-a5d8-0c954d016ad3" status: 200 len: 1366 microversion: 2.1 time: 0.168383 May 19 13:41:19.798017 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 426/868] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:41:19 2022] GET /compute/v2.1/servers/fbe881d3-e162-43fb-a5d8-0c954d016ad3 => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:41:20.144357 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-e87ac3e1-1c28-4340-b4b2-dff35152f294 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:41:20.144981 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-e87ac3e1-1c28-4340-b4b2-dff35152f294 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] [instance: 712420e9-2543-45fe-8b45-e46ca934a579] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:41:20.153205 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-e87ac3e1-1c28-4340-b4b2-dff35152f294 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:41:20.153841 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-e87ac3e1-1c28-4340-b4b2-dff35152f294 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:41:20.154619 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-e87ac3e1-1c28-4340-b4b2-dff35152f294 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:41:20.155034 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-e87ac3e1-1c28-4340-b4b2-dff35152f294 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:41:20.390511 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-e87ac3e1-1c28-4340-b4b2-dff35152f294 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0a4b41707d444581ee0aa2296ac0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ad7b921dbc4a8d9e9be0d50385deee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:41:20.399323 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-e87ac3e1-1c28-4340-b4b2-dff35152f294 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] 10.222.0.24 "GET /compute/v2.1/servers/712420e9-2543-45fe-8b45-e46ca934a579" status: 200 len: 1266 microversion: 2.1 time: 0.258975 May 19 13:41:20.399903 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 443/869] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:41:20 2022] GET /compute/v2.1/servers/712420e9-2543-45fe-8b45-e46ca934a579 => generated 1266 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:41:20.530923 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [req-34cd41bb-d227-4ccc-bcfd-0ddf8bcfe573 req-aced4bb5-698c-4350-bae9-736ddd520c8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbe881d3-e162-43fb-a5d8-0c954d016ad3", "tag": "b9843349-3c7d-462a-a582-ab4d30a6e9f1"}]} {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:41:20.541894 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [req-34cd41bb-d227-4ccc-bcfd-0ddf8bcfe573 req-aced4bb5-698c-4350-bae9-736ddd520c8b service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:41:20.542576 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [req-34cd41bb-d227-4ccc-bcfd-0ddf8bcfe573 req-aced4bb5-698c-4350-bae9-736ddd520c8b service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:41:20.560395 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.compute.server_external_events [req-34cd41bb-d227-4ccc-bcfd-0ddf8bcfe573 req-aced4bb5-698c-4350-bae9-736ddd520c8b service nova] Creating event network-changed:b9843349-3c7d-462a-a582-ab4d30a6e9f1 for instance fbe881d3-e162-43fb-a5d8-0c954d016ad3 on hv-cinder-84112 May 19 13:41:20.567493 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [req-34cd41bb-d227-4ccc-bcfd-0ddf8bcfe573 req-aced4bb5-698c-4350-bae9-736ddd520c8b service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040094 May 19 13:41:20.568551 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 427/870] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:41:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:41:20.814853 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-63390fac-dfa0-42a5-bad6-30876f3df0a3 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:41:20.815654 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-63390fac-dfa0-42a5-bad6-30876f3df0a3 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: fbe881d3-e162-43fb-a5d8-0c954d016ad3] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:41:20.822038 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-63390fac-dfa0-42a5-bad6-30876f3df0a3 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:41:20.822486 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-63390fac-dfa0-42a5-bad6-30876f3df0a3 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:41:20.823239 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-63390fac-dfa0-42a5-bad6-30876f3df0a3 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:41:20.823642 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-63390fac-dfa0-42a5-bad6-30876f3df0a3 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:41:21.281826 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-63390fac-dfa0-42a5-bad6-30876f3df0a3 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa4a2a39deb4e7ba54032acec14e029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc560e8b75194743bbb46d903b481357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:41:21.290617 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-63390fac-dfa0-42a5-bad6-30876f3df0a3 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "GET /compute/v2.1/servers/fbe881d3-e162-43fb-a5d8-0c954d016ad3" status: 200 len: 1366 microversion: 2.1 time: 0.479683 May 19 13:41:21.291184 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 444/871] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:41:20 2022] GET /compute/v2.1/servers/fbe881d3-e162-43fb-a5d8-0c954d016ad3 => generated 1366 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:41:21.420016 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-3c196ab7-040b-4222-a955-b337cc0603d5 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:41:21.420855 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-3c196ab7-040b-4222-a955-b337cc0603d5 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] [instance: 712420e9-2543-45fe-8b45-e46ca934a579] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:41:21.428553 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-3c196ab7-040b-4222-a955-b337cc0603d5 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:41:21.429000 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-3c196ab7-040b-4222-a955-b337cc0603d5 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:41:21.429801 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-3c196ab7-040b-4222-a955-b337cc0603d5 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:41:21.430238 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-3c196ab7-040b-4222-a955-b337cc0603d5 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:41:21.569706 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-3c196ab7-040b-4222-a955-b337cc0603d5 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0a4b41707d444581ee0aa2296ac0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ad7b921dbc4a8d9e9be0d50385deee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:41:21.577848 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-3c196ab7-040b-4222-a955-b337cc0603d5 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] 10.222.0.24 "GET /compute/v2.1/servers/712420e9-2543-45fe-8b45-e46ca934a579" status: 200 len: 1266 microversion: 2.1 time: 0.163980 May 19 13:41:21.578423 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 428/872] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:41:21 2022] GET /compute/v2.1/servers/712420e9-2543-45fe-8b45-e46ca934a579 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:41:22.307856 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-a05e15d4-1cdc-4e32-9a87-6f8ed0da429c tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:41:22.308432 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-a05e15d4-1cdc-4e32-9a87-6f8ed0da429c tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: fbe881d3-e162-43fb-a5d8-0c954d016ad3] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:41:22.318285 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-a05e15d4-1cdc-4e32-9a87-6f8ed0da429c tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:41:22.318737 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-a05e15d4-1cdc-4e32-9a87-6f8ed0da429c tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:41:22.319500 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-a05e15d4-1cdc-4e32-9a87-6f8ed0da429c tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:41:22.319924 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-a05e15d4-1cdc-4e32-9a87-6f8ed0da429c tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:41:22.541043 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-a05e15d4-1cdc-4e32-9a87-6f8ed0da429c tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa4a2a39deb4e7ba54032acec14e029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc560e8b75194743bbb46d903b481357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:41:22.555206 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-a05e15d4-1cdc-4e32-9a87-6f8ed0da429c tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "GET /compute/v2.1/servers/fbe881d3-e162-43fb-a5d8-0c954d016ad3" status: 200 len: 1366 microversion: 2.1 time: 0.251271 May 19 13:41:22.564983 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 445/873] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:41:22 2022] GET /compute/v2.1/servers/fbe881d3-e162-43fb-a5d8-0c954d016ad3 => generated 1366 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:41:22.595822 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-f88d533f-4897-4f6b-87af-c1b31caac44c tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:41:22.596579 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-f88d533f-4897-4f6b-87af-c1b31caac44c tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] [instance: 712420e9-2543-45fe-8b45-e46ca934a579] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:41:22.604382 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-f88d533f-4897-4f6b-87af-c1b31caac44c tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:41:22.604983 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-f88d533f-4897-4f6b-87af-c1b31caac44c tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:41:22.605885 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-f88d533f-4897-4f6b-87af-c1b31caac44c tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:41:22.606419 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-f88d533f-4897-4f6b-87af-c1b31caac44c tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:41:22.754955 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-f88d533f-4897-4f6b-87af-c1b31caac44c tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0a4b41707d444581ee0aa2296ac0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ad7b921dbc4a8d9e9be0d50385deee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:41:22.763095 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-f88d533f-4897-4f6b-87af-c1b31caac44c tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] 10.222.0.24 "GET /compute/v2.1/servers/712420e9-2543-45fe-8b45-e46ca934a579" status: 200 len: 1266 microversion: 2.1 time: 0.171290 May 19 13:41:22.763678 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 429/874] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:41:22 2022] GET /compute/v2.1/servers/712420e9-2543-45fe-8b45-e46ca934a579 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:41:23.576634 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-f7943a63-8fe6-4033-9b3d-15dab20414ee tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:41:23.577541 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-f7943a63-8fe6-4033-9b3d-15dab20414ee tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: fbe881d3-e162-43fb-a5d8-0c954d016ad3] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:41:23.586355 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-f7943a63-8fe6-4033-9b3d-15dab20414ee tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:41:23.586805 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-f7943a63-8fe6-4033-9b3d-15dab20414ee tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:41:23.587557 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-f7943a63-8fe6-4033-9b3d-15dab20414ee tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:41:23.587986 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-f7943a63-8fe6-4033-9b3d-15dab20414ee tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:41:23.725189 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-f7943a63-8fe6-4033-9b3d-15dab20414ee tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa4a2a39deb4e7ba54032acec14e029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc560e8b75194743bbb46d903b481357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:41:23.732965 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-f7943a63-8fe6-4033-9b3d-15dab20414ee tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "GET /compute/v2.1/servers/fbe881d3-e162-43fb-a5d8-0c954d016ad3" status: 200 len: 1366 microversion: 2.1 time: 0.162991 May 19 13:41:23.733559 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 446/875] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:41:23 2022] GET /compute/v2.1/servers/fbe881d3-e162-43fb-a5d8-0c954d016ad3 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:41:23.780436 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-d886ee2a-2ce6-4413-96d4-9d7570c34900 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:41:23.781042 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-d886ee2a-2ce6-4413-96d4-9d7570c34900 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] [instance: 712420e9-2543-45fe-8b45-e46ca934a579] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:41:23.788027 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-d886ee2a-2ce6-4413-96d4-9d7570c34900 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:41:23.788486 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-d886ee2a-2ce6-4413-96d4-9d7570c34900 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:41:23.789255 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-d886ee2a-2ce6-4413-96d4-9d7570c34900 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:41:23.789788 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-d886ee2a-2ce6-4413-96d4-9d7570c34900 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:41:23.926016 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-d886ee2a-2ce6-4413-96d4-9d7570c34900 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0a4b41707d444581ee0aa2296ac0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ad7b921dbc4a8d9e9be0d50385deee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:41:23.934688 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-d886ee2a-2ce6-4413-96d4-9d7570c34900 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] 10.222.0.24 "GET /compute/v2.1/servers/712420e9-2543-45fe-8b45-e46ca934a579" status: 200 len: 1266 microversion: 2.1 time: 0.158187 May 19 13:41:23.935273 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 430/876] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:41:23 2022] GET /compute/v2.1/servers/712420e9-2543-45fe-8b45-e46ca934a579 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:41:24.563932 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [req-469d216c-3da3-4242-b22e-6804e23fe094 req-93fd400e-764d-44a8-813a-c9784c53db54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbe881d3-e162-43fb-a5d8-0c954d016ad3", "name": "network-vif-plugged", "status": "completed", "tag": "b9843349-3c7d-462a-a582-ab4d30a6e9f1"}]} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:41:24.573513 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-469d216c-3da3-4242-b22e-6804e23fe094 req-93fd400e-764d-44a8-813a-c9784c53db54 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:41:24.574121 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-469d216c-3da3-4242-b22e-6804e23fe094 req-93fd400e-764d-44a8-813a-c9784c53db54 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:41:24.588806 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.compute.server_external_events [req-469d216c-3da3-4242-b22e-6804e23fe094 req-93fd400e-764d-44a8-813a-c9784c53db54 service nova] Creating event network-vif-plugged:b9843349-3c7d-462a-a582-ab4d30a6e9f1 for instance fbe881d3-e162-43fb-a5d8-0c954d016ad3 on hv-cinder-84112 May 19 13:41:24.593899 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [req-469d216c-3da3-4242-b22e-6804e23fe094 req-93fd400e-764d-44a8-813a-c9784c53db54 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033733 May 19 13:41:24.594562 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 447/877] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:41:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:41:24.749423 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-2238b2ac-d8b4-40f7-8681-38b6bfbdf9d8 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:41:24.750042 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-2238b2ac-d8b4-40f7-8681-38b6bfbdf9d8 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: fbe881d3-e162-43fb-a5d8-0c954d016ad3] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:41:24.756557 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-2238b2ac-d8b4-40f7-8681-38b6bfbdf9d8 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:41:24.757001 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-2238b2ac-d8b4-40f7-8681-38b6bfbdf9d8 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:41:24.757795 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-2238b2ac-d8b4-40f7-8681-38b6bfbdf9d8 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:41:24.758213 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-2238b2ac-d8b4-40f7-8681-38b6bfbdf9d8 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:41:24.947362 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-2238b2ac-d8b4-40f7-8681-38b6bfbdf9d8 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa4a2a39deb4e7ba54032acec14e029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc560e8b75194743bbb46d903b481357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:41:24.952124 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-98fbcf04-f8de-484f-af10-658492fa2004 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:41:24.952824 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-98fbcf04-f8de-484f-af10-658492fa2004 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] [instance: 712420e9-2543-45fe-8b45-e46ca934a579] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:41:24.955533 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-2238b2ac-d8b4-40f7-8681-38b6bfbdf9d8 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "GET /compute/v2.1/servers/fbe881d3-e162-43fb-a5d8-0c954d016ad3" status: 200 len: 1366 microversion: 2.1 time: 0.209988 May 19 13:41:24.956109 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 431/878] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:41:24 2022] GET /compute/v2.1/servers/fbe881d3-e162-43fb-a5d8-0c954d016ad3 => generated 1366 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:41:24.963121 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-98fbcf04-f8de-484f-af10-658492fa2004 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:41:24.963582 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-98fbcf04-f8de-484f-af10-658492fa2004 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:41:24.964341 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-98fbcf04-f8de-484f-af10-658492fa2004 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:41:24.964772 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-98fbcf04-f8de-484f-af10-658492fa2004 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:41:25.102897 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-98fbcf04-f8de-484f-af10-658492fa2004 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0a4b41707d444581ee0aa2296ac0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ad7b921dbc4a8d9e9be0d50385deee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:41:25.114009 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-98fbcf04-f8de-484f-af10-658492fa2004 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] 10.222.0.24 "GET /compute/v2.1/servers/712420e9-2543-45fe-8b45-e46ca934a579" status: 200 len: 1266 microversion: 2.1 time: 0.165733 May 19 13:41:25.114778 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 448/879] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:41:24 2022] GET /compute/v2.1/servers/712420e9-2543-45fe-8b45-e46ca934a579 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:41:25.977117 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-a8e07d56-e336-42b6-892e-d40672bd13f2 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:41:25.978145 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-a8e07d56-e336-42b6-892e-d40672bd13f2 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: fbe881d3-e162-43fb-a5d8-0c954d016ad3] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:41:25.981246 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_cell0:SELECT=2 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:41:25.990897 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-a8e07d56-e336-42b6-892e-d40672bd13f2 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:41:25.991338 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-a8e07d56-e336-42b6-892e-d40672bd13f2 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:41:25.992103 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-a8e07d56-e336-42b6-892e-d40672bd13f2 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:41:25.992529 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-a8e07d56-e336-42b6-892e-d40672bd13f2 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:41:26.131610 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-3f4d49e5-7579-418b-86f3-ca0d45fb9403 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:41:26.132233 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-3f4d49e5-7579-418b-86f3-ca0d45fb9403 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] [instance: 712420e9-2543-45fe-8b45-e46ca934a579] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:41:26.139555 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-3f4d49e5-7579-418b-86f3-ca0d45fb9403 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:41:26.140004 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-3f4d49e5-7579-418b-86f3-ca0d45fb9403 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:41:26.140763 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-3f4d49e5-7579-418b-86f3-ca0d45fb9403 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:41:26.142043 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-3f4d49e5-7579-418b-86f3-ca0d45fb9403 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:41:26.144017 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-a8e07d56-e336-42b6-892e-d40672bd13f2 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa4a2a39deb4e7ba54032acec14e029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc560e8b75194743bbb46d903b481357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:41:26.151782 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-a8e07d56-e336-42b6-892e-d40672bd13f2 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "GET /compute/v2.1/servers/fbe881d3-e162-43fb-a5d8-0c954d016ad3" status: 200 len: 1366 microversion: 2.1 time: 0.181400 May 19 13:41:26.152351 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 432/880] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:41:25 2022] GET /compute/v2.1/servers/fbe881d3-e162-43fb-a5d8-0c954d016ad3 => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:41:26.281342 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-3f4d49e5-7579-418b-86f3-ca0d45fb9403 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0a4b41707d444581ee0aa2296ac0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ad7b921dbc4a8d9e9be0d50385deee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:41:26.289330 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-3f4d49e5-7579-418b-86f3-ca0d45fb9403 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] 10.222.0.24 "GET /compute/v2.1/servers/712420e9-2543-45fe-8b45-e46ca934a579" status: 200 len: 1266 microversion: 2.1 time: 0.161721 May 19 13:41:26.289929 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 449/881] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:41:26 2022] GET /compute/v2.1/servers/712420e9-2543-45fe-8b45-e46ca934a579 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:41:27.168856 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-6d516bf6-af87-4692-94ec-af0452904e5b tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:41:27.169998 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-6d516bf6-af87-4692-94ec-af0452904e5b tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: fbe881d3-e162-43fb-a5d8-0c954d016ad3] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:41:27.177127 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-6d516bf6-af87-4692-94ec-af0452904e5b tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:41:27.177995 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-6d516bf6-af87-4692-94ec-af0452904e5b tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:41:27.179043 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-6d516bf6-af87-4692-94ec-af0452904e5b tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:41:27.179581 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-6d516bf6-af87-4692-94ec-af0452904e5b tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:41:27.309577 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-eeb324a7-809c-4c77-8b62-663c7af7b22d tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:41:27.310275 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-eeb324a7-809c-4c77-8b62-663c7af7b22d tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] [instance: 712420e9-2543-45fe-8b45-e46ca934a579] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:41:27.313446 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_cell0:SELECT=2 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:41:27.313666 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-6d516bf6-af87-4692-94ec-af0452904e5b tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa4a2a39deb4e7ba54032acec14e029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc560e8b75194743bbb46d903b481357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:41:27.314353 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_cell0:SELECT=12 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:41:27.320122 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-eeb324a7-809c-4c77-8b62-663c7af7b22d tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:41:27.320577 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-eeb324a7-809c-4c77-8b62-663c7af7b22d tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:41:27.321494 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-eeb324a7-809c-4c77-8b62-663c7af7b22d tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:41:27.321929 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-eeb324a7-809c-4c77-8b62-663c7af7b22d tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:41:27.322221 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-6d516bf6-af87-4692-94ec-af0452904e5b tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "GET /compute/v2.1/servers/fbe881d3-e162-43fb-a5d8-0c954d016ad3" status: 200 len: 1556 microversion: 2.1 time: 0.157236 May 19 13:41:27.323125 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 433/882] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:41:27 2022] GET /compute/v2.1/servers/fbe881d3-e162-43fb-a5d8-0c954d016ad3 => generated 1556 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:41:27.339064 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-288d1852-bd3a-402e-8115-c6ea29a89b29 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:41:27.339695 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-288d1852-bd3a-402e-8115-c6ea29a89b29 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: fbe881d3-e162-43fb-a5d8-0c954d016ad3] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:41:27.347005 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-288d1852-bd3a-402e-8115-c6ea29a89b29 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:41:27.347564 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-288d1852-bd3a-402e-8115-c6ea29a89b29 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:41:27.348415 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-288d1852-bd3a-402e-8115-c6ea29a89b29 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:41:27.349095 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-288d1852-bd3a-402e-8115-c6ea29a89b29 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:41:27.432979 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-288d1852-bd3a-402e-8115-c6ea29a89b29 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "GET /compute/v2.1/servers/fbe881d3-e162-43fb-a5d8-0c954d016ad3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097838 May 19 13:41:27.433741 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 434/883] 10.222.0.24 () {58 vars in 1274 bytes} [Thu May 19 13:41:27 2022] GET /compute/v2.1/servers/fbe881d3-e162-43fb-a5d8-0c954d016ad3/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 13:41:27.581889 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-eeb324a7-809c-4c77-8b62-663c7af7b22d tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0a4b41707d444581ee0aa2296ac0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ad7b921dbc4a8d9e9be0d50385deee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:41:27.590863 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-eeb324a7-809c-4c77-8b62-663c7af7b22d tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] 10.222.0.24 "GET /compute/v2.1/servers/712420e9-2543-45fe-8b45-e46ca934a579" status: 200 len: 1266 microversion: 2.1 time: 0.287522 May 19 13:41:27.591410 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 450/884] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:41:27 2022] GET /compute/v2.1/servers/712420e9-2543-45fe-8b45-e46ca934a579 => generated 1266 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:41:28.577650 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_cell0:SELECT=8 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:41:28.584113 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [req-96814a1b-f84a-4d4b-9ab3-513f9442a1c3 req-5f9cb25a-22f8-4eb0-b5f1-56d496dcdfba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "712420e9-2543-45fe-8b45-e46ca934a579", "name": "network-vif-plugged", "status": "completed", "tag": "d0ce9e8c-78f4-482c-b815-588341b22d40"}]} {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:41:28.601906 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [req-96814a1b-f84a-4d4b-9ab3-513f9442a1c3 req-5f9cb25a-22f8-4eb0-b5f1-56d496dcdfba service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:41:28.602782 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [req-96814a1b-f84a-4d4b-9ab3-513f9442a1c3 req-5f9cb25a-22f8-4eb0-b5f1-56d496dcdfba service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:41:28.614974 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-24c67b4f-5994-47d4-aca0-07512b8d75f4 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:41:28.617457 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-24c67b4f-5994-47d4-aca0-07512b8d75f4 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] [instance: 712420e9-2543-45fe-8b45-e46ca934a579] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:41:28.621714 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.compute.server_external_events [req-96814a1b-f84a-4d4b-9ab3-513f9442a1c3 req-5f9cb25a-22f8-4eb0-b5f1-56d496dcdfba service nova] Creating event network-vif-plugged:d0ce9e8c-78f4-482c-b815-588341b22d40 for instance 712420e9-2543-45fe-8b45-e46ca934a579 on hv-cinder-84112 May 19 13:41:28.627748 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [req-96814a1b-f84a-4d4b-9ab3-513f9442a1c3 req-5f9cb25a-22f8-4eb0-b5f1-56d496dcdfba service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051469 May 19 13:41:28.628781 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 435/885] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:41:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:41:28.634633 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-24c67b4f-5994-47d4-aca0-07512b8d75f4 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:41:28.635259 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-24c67b4f-5994-47d4-aca0-07512b8d75f4 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:41:28.636211 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-24c67b4f-5994-47d4-aca0-07512b8d75f4 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:41:28.637176 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-24c67b4f-5994-47d4-aca0-07512b8d75f4 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:41:28.658652 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [req-4d6c188e-e324-45d2-9607-ff5613c81a15 req-d498324b-7880-48bb-9763-28ed614b5410 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbe881d3-e162-43fb-a5d8-0c954d016ad3", "tag": "b9843349-3c7d-462a-a582-ab4d30a6e9f1"}]} {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:41:28.667835 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [req-4d6c188e-e324-45d2-9607-ff5613c81a15 req-d498324b-7880-48bb-9763-28ed614b5410 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:41:28.668266 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [req-4d6c188e-e324-45d2-9607-ff5613c81a15 req-d498324b-7880-48bb-9763-28ed614b5410 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:41:28.682581 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.compute.server_external_events [req-4d6c188e-e324-45d2-9607-ff5613c81a15 req-d498324b-7880-48bb-9763-28ed614b5410 service nova] Creating event network-changed:b9843349-3c7d-462a-a582-ab4d30a6e9f1 for instance fbe881d3-e162-43fb-a5d8-0c954d016ad3 on hv-cinder-84112 May 19 13:41:28.688351 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [req-4d6c188e-e324-45d2-9607-ff5613c81a15 req-d498324b-7880-48bb-9763-28ed614b5410 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033673 May 19 13:41:28.691848 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 436/886] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:41:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:41:28.822908 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-24c67b4f-5994-47d4-aca0-07512b8d75f4 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0a4b41707d444581ee0aa2296ac0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ad7b921dbc4a8d9e9be0d50385deee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:41:28.830953 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-24c67b4f-5994-47d4-aca0-07512b8d75f4 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] 10.222.0.24 "GET /compute/v2.1/servers/712420e9-2543-45fe-8b45-e46ca934a579" status: 200 len: 1266 microversion: 2.1 time: 0.225986 May 19 13:41:28.841878 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 451/887] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:41:28 2022] GET /compute/v2.1/servers/712420e9-2543-45fe-8b45-e46ca934a579 => generated 1266 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:41:29.850432 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-415489c1-6d06-4199-a492-8aa09d47c0a8 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:41:29.851199 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-415489c1-6d06-4199-a492-8aa09d47c0a8 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] [instance: 712420e9-2543-45fe-8b45-e46ca934a579] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:41:29.857813 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-415489c1-6d06-4199-a492-8aa09d47c0a8 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:41:29.858324 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-415489c1-6d06-4199-a492-8aa09d47c0a8 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:41:29.859084 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-415489c1-6d06-4199-a492-8aa09d47c0a8 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:41:29.859513 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-415489c1-6d06-4199-a492-8aa09d47c0a8 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:41:30.004221 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-415489c1-6d06-4199-a492-8aa09d47c0a8 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0a4b41707d444581ee0aa2296ac0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ad7b921dbc4a8d9e9be0d50385deee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:41:30.012816 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-415489c1-6d06-4199-a492-8aa09d47c0a8 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] 10.222.0.24 "GET /compute/v2.1/servers/712420e9-2543-45fe-8b45-e46ca934a579" status: 200 len: 1266 microversion: 2.1 time: 0.167360 May 19 13:41:30.013387 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 437/888] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:41:29 2022] GET /compute/v2.1/servers/712420e9-2543-45fe-8b45-e46ca934a579 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:41:31.089978 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-392b67f2-36e8-4a0a-b07c-78715c6534d6 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:41:31.090590 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-392b67f2-36e8-4a0a-b07c-78715c6534d6 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] [instance: 712420e9-2543-45fe-8b45-e46ca934a579] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:41:31.096873 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-392b67f2-36e8-4a0a-b07c-78715c6534d6 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:41:31.097316 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-392b67f2-36e8-4a0a-b07c-78715c6534d6 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:41:31.098100 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-392b67f2-36e8-4a0a-b07c-78715c6534d6 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:41:31.098640 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-392b67f2-36e8-4a0a-b07c-78715c6534d6 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:41:31.232310 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-392b67f2-36e8-4a0a-b07c-78715c6534d6 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0a4b41707d444581ee0aa2296ac0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ad7b921dbc4a8d9e9be0d50385deee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:41:31.240651 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-392b67f2-36e8-4a0a-b07c-78715c6534d6 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] 10.222.0.24 "GET /compute/v2.1/servers/712420e9-2543-45fe-8b45-e46ca934a579" status: 200 len: 1452 microversion: 2.1 time: 0.213088 May 19 13:41:31.241297 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 452/889] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:41:31 2022] GET /compute/v2.1/servers/712420e9-2543-45fe-8b45-e46ca934a579 => generated 1452 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:41:31.257596 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-bd7b2534-0c49-40f9-9f50-fedffcb9b6b3 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:41:31.258294 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-bd7b2534-0c49-40f9-9f50-fedffcb9b6b3 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] [instance: 712420e9-2543-45fe-8b45-e46ca934a579] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:41:31.265432 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-bd7b2534-0c49-40f9-9f50-fedffcb9b6b3 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:41:31.266033 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-bd7b2534-0c49-40f9-9f50-fedffcb9b6b3 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:41:31.266811 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-bd7b2534-0c49-40f9-9f50-fedffcb9b6b3 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:41:31.267224 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-bd7b2534-0c49-40f9-9f50-fedffcb9b6b3 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:41:31.404538 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-bd7b2534-0c49-40f9-9f50-fedffcb9b6b3 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0a4b41707d444581ee0aa2296ac0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ad7b921dbc4a8d9e9be0d50385deee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:41:31.412325 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-bd7b2534-0c49-40f9-9f50-fedffcb9b6b3 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] 10.222.0.24 "GET /compute/v2.1/servers/712420e9-2543-45fe-8b45-e46ca934a579" status: 200 len: 1452 microversion: 2.1 time: 0.159016 May 19 13:41:31.413428 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 438/890] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:41:31 2022] GET /compute/v2.1/servers/712420e9-2543-45fe-8b45-e46ca934a579 => generated 1452 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:41:33.141178 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [req-84ae9277-d63c-4d1f-acf1-50b5a3a5fec9 req-4583e49e-90f9-466c-8ddf-203f94b57778 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "712420e9-2543-45fe-8b45-e46ca934a579", "tag": "d0ce9e8c-78f4-482c-b815-588341b22d40"}]} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:41:33.150288 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-84ae9277-d63c-4d1f-acf1-50b5a3a5fec9 req-4583e49e-90f9-466c-8ddf-203f94b57778 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:41:33.150722 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-84ae9277-d63c-4d1f-acf1-50b5a3a5fec9 req-4583e49e-90f9-466c-8ddf-203f94b57778 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:41:33.162098 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.compute.server_external_events [req-84ae9277-d63c-4d1f-acf1-50b5a3a5fec9 req-4583e49e-90f9-466c-8ddf-203f94b57778 service nova] Creating event network-changed:d0ce9e8c-78f4-482c-b815-588341b22d40 for instance 712420e9-2543-45fe-8b45-e46ca934a579 on hv-cinder-84112 May 19 13:41:33.167439 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [req-84ae9277-d63c-4d1f-acf1-50b5a3a5fec9 req-4583e49e-90f9-466c-8ddf-203f94b57778 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030000 May 19 13:41:33.168076 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 453/891] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:41:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:42:04.698221 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-7578458b-1e15-436a-8930-9b735e65c21d tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:42:04.699147 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-7578458b-1e15-436a-8930-9b735e65c21d tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: fbe881d3-e162-43fb-a5d8-0c954d016ad3] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:42:04.702799 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:42:04.703876 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_cell1:SELECT=77 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:42:04.711148 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-7578458b-1e15-436a-8930-9b735e65c21d tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:42:04.711743 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-7578458b-1e15-436a-8930-9b735e65c21d tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:42:04.712508 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-7578458b-1e15-436a-8930-9b735e65c21d tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:42:04.712940 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-7578458b-1e15-436a-8930-9b735e65c21d tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:42:04.738076 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-7578458b-1e15-436a-8930-9b735e65c21d tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "GET /compute/v2.1/servers/fbe881d3-e162-43fb-a5d8-0c954d016ad3/ips" status: 200 len: 149 microversion: 2.1 time: 0.046611 May 19 13:42:04.738646 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 439/892] 10.222.0.24 () {58 vars in 1247 bytes} [Thu May 19 13:42:04 2022] GET /compute/v2.1/servers/fbe881d3-e162-43fb-a5d8-0c954d016ad3/ips => generated 149 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:42:06.121516 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=4 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:42:06.122209 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_cell1:SELECT=75 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:42:06.127628 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-60f0d45e-24e1-414d-9bd5-0f9b5e344551 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c333af7f-6171-4962-9180-9e563704adf0"}} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:42:06.129048 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-60f0d45e-24e1-414d-9bd5-0f9b5e344551 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: fbe881d3-e162-43fb-a5d8-0c954d016ad3] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:42:06.136970 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-60f0d45e-24e1-414d-9bd5-0f9b5e344551 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:42:06.137582 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-60f0d45e-24e1-414d-9bd5-0f9b5e344551 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:42:06.138361 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-60f0d45e-24e1-414d-9bd5-0f9b5e344551 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:42:06.138782 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-60f0d45e-24e1-414d-9bd5-0f9b5e344551 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:42:06.419444 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-60f0d45e-24e1-414d-9bd5-0f9b5e344551 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "POST /compute/v2.1/servers/fbe881d3-e162-43fb-a5d8-0c954d016ad3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.299355 May 19 13:42:06.420052 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 454/893] 10.222.0.24 () {60 vars in 1322 bytes} [Thu May 19 13:42:06 2022] POST /compute/v2.1/servers/fbe881d3-e162-43fb-a5d8-0c954d016ad3/os-volume_attachments => generated 194 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:42:13.985210 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-923bd7d3-4915-4fbd-9347-3d02e9a8207a tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Action: 'create', calling method: .version_select at 0x7f7c2a7f00d0>, body: {"keypair": {"name": "tempest-keypair-1808020144", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAXs5GYu2YN4oSRn+/GrXY/4UhDQ90D6ubPRFJ/Y8YieRK6MIBNq/N6q+XcQEhHCTqTGpyGna3lWfJAC/FFn4OLd1TWWbgFD6FIRX0YQUhbtMpNcNnqKOT+yJdXFVDCOBA=="}} {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:42:14.000352 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.quota [None req-923bd7d3-4915-4fbd-9347-3d02e9a8207a tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Getting quotas for project bc560e8b75194743bbb46d903b481357. Resources: {'key_pairs'} {{(pid=120472) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 13:42:14.004515 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.quota [None req-923bd7d3-4915-4fbd-9347-3d02e9a8207a tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Getting quotas for user daa4a2a39deb4e7ba54032acec14e029 and project bc560e8b75194743bbb46d903b481357. Resources: {'key_pairs'} {{(pid=120472) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 13:42:14.031319 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-923bd7d3-4915-4fbd-9347-3d02e9a8207a tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050045 May 19 13:42:14.031895 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 440/894] 10.222.0.24 () {60 vars in 1158 bytes} [Thu May 19 13:42:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:42:15.388985 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-c42c798e-e11b-4c90-8e19-146cd3684135 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:42:15.389552 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-c42c798e-e11b-4c90-8e19-146cd3684135 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] [instance: b649c85b-1ed3-454b-8ca3-bb53ebc85d91] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:42:15.397051 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-c42c798e-e11b-4c90-8e19-146cd3684135 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:42:15.397530 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-c42c798e-e11b-4c90-8e19-146cd3684135 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:42:15.398300 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-c42c798e-e11b-4c90-8e19-146cd3684135 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:42:15.398730 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-c42c798e-e11b-4c90-8e19-146cd3684135 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:42:15.422144 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.objects.instance [None req-c42c798e-e11b-4c90-8e19-146cd3684135 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lazy-loading 'flavor' on Instance uuid b649c85b-1ed3-454b-8ca3-bb53ebc85d91 {{(pid=120471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 13:42:15.499196 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-c42c798e-e11b-4c90-8e19-146cd3684135 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] 10.222.0.24 "POST /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91/action" status: 202 len: 0 microversion: 2.1 time: 0.115120 May 19 13:42:15.500229 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 455/895] 10.222.0.24 () {60 vars in 1277 bytes} [Thu May 19 13:42:15 2022] POST /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 13:42:15.505378 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_cell1:SELECT=4 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:42:15.509892 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-174d5415-1da2-4b31-84ec-10b2378ddfa6 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:42:15.510494 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-174d5415-1da2-4b31-84ec-10b2378ddfa6 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] [instance: b649c85b-1ed3-454b-8ca3-bb53ebc85d91] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:42:15.518320 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-174d5415-1da2-4b31-84ec-10b2378ddfa6 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:42:15.518780 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-174d5415-1da2-4b31-84ec-10b2378ddfa6 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:42:15.519527 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-174d5415-1da2-4b31-84ec-10b2378ddfa6 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:42:15.519981 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-174d5415-1da2-4b31-84ec-10b2378ddfa6 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:42:15.610856 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-31bfb899-fa33-4576-88cb-c7c0a6bf65a7 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1313002436", "imageRef": "9beb860d-9c3f-4244-80aa-71a9c337a429", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "39a38089-655e-4b34-b99f-11a97c39ff7d"}], "security_groups": [{"name": "tempest-securitygroup--971683453"}], "key_name": "tempest-keypair-1808020144", "user_data": "}} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:42:15.660903 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-174d5415-1da2-4b31-84ec-10b2378ddfa6 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485d40bf82e421bafbb714c60c96df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430899def10d40c192f0d54b8ebf0af5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:42:15.669354 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-174d5415-1da2-4b31-84ec-10b2378ddfa6 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] 10.222.0.24 "GET /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91" status: 200 len: 1567 microversion: 2.1 time: 0.164376 May 19 13:42:15.670037 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 441/896] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:42:15 2022] GET /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91 => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:42:15.715676 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.network.neutron [None req-31bfb899-fa33-4576-88cb-c7c0a6bf65a7 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] validate_networks() for [('39a38089-655e-4b34-b99f-11a97c39ff7d', None, None, None, None, None)] {{(pid=120471) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 13:42:16.111234 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.virt.hardware [None req-31bfb899-fa33-4576-88cb-c7c0a6bf65a7 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Flavor limits 0:0:0 {{(pid=120471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 13:42:16.111663 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.virt.hardware [None req-31bfb899-fa33-4576-88cb-c7c0a6bf65a7 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Image limits 0:0:0 {{(pid=120471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 13:42:16.112134 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.virt.hardware [None req-31bfb899-fa33-4576-88cb-c7c0a6bf65a7 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Flavor pref 0:0:0 {{(pid=120471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 13:42:16.112841 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.virt.hardware [None req-31bfb899-fa33-4576-88cb-c7c0a6bf65a7 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Image pref 0:0:0 {{(pid=120471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 13:42:16.113349 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.virt.hardware [None req-31bfb899-fa33-4576-88cb-c7c0a6bf65a7 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 13:42:16.123530 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-31bfb899-fa33-4576-88cb-c7c0a6bf65a7 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:42:16.123985 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-31bfb899-fa33-4576-88cb-c7c0a6bf65a7 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:42:16.124776 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-31bfb899-fa33-4576-88cb-c7c0a6bf65a7 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:42:16.125185 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-31bfb899-fa33-4576-88cb-c7c0a6bf65a7 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:42:16.143438 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.quota [None req-31bfb899-fa33-4576-88cb-c7c0a6bf65a7 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Getting quotas for project bc560e8b75194743bbb46d903b481357. Resources: {'instances', 'cores', 'ram'} {{(pid=120471) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 13:42:16.147774 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.quota [None req-31bfb899-fa33-4576-88cb-c7c0a6bf65a7 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Getting quotas for user daa4a2a39deb4e7ba54032acec14e029 and project bc560e8b75194743bbb46d903b481357. Resources: {'instances', 'cores', 'ram'} {{(pid=120471) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 13:42:16.159914 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-31bfb899-fa33-4576-88cb-c7c0a6bf65a7 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Going to run 1 instances... {{(pid=120471) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 13:42:16.162463 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-31bfb899-fa33-4576-88cb-c7c0a6bf65a7 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: d4831f4e-33ee-459b-ac94-43ffe068e9fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9beb860d-9c3f-4244-80aa-71a9c337a429',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120471) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 13:42:16.210574 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-31bfb899-fa33-4576-88cb-c7c0a6bf65a7 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.604411 May 19 13:42:16.211197 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 456/897] 10.222.0.24 () {60 vars in 1146 bytes} [Thu May 19 13:42:15 2022] POST /compute/v2.1/servers => generated 401 bytes in 606 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 19 13:42:16.221602 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-cf2b25c4-fb73-44ce-ac79-c8863e6fa4cb tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:42:16.222544 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-cf2b25c4-fb73-44ce-ac79-c8863e6fa4cb tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: d4831f4e-33ee-459b-ac94-43ffe068e9fc] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:42:16.278415 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-cf2b25c4-fb73-44ce-ac79-c8863e6fa4cb tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa4a2a39deb4e7ba54032acec14e029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc560e8b75194743bbb46d903b481357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:42:16.285219 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-cf2b25c4-fb73-44ce-ac79-c8863e6fa4cb tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "GET /compute/v2.1/servers/d4831f4e-33ee-459b-ac94-43ffe068e9fc" status: 200 len: 1242 microversion: 2.1 time: 0.067619 May 19 13:42:16.286127 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 442/898] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:42:16 2022] GET /compute/v2.1/servers/d4831f4e-33ee-459b-ac94-43ffe068e9fc => generated 1242 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:42:16.690862 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-1960ec41-fd1b-4518-9303-646a2b56c079 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:42:16.691639 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-1960ec41-fd1b-4518-9303-646a2b56c079 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] [instance: b649c85b-1ed3-454b-8ca3-bb53ebc85d91] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:42:16.869901 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-1960ec41-fd1b-4518-9303-646a2b56c079 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:42:16.870362 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-1960ec41-fd1b-4518-9303-646a2b56c079 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:42:16.871155 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-1960ec41-fd1b-4518-9303-646a2b56c079 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:42:16.871585 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-1960ec41-fd1b-4518-9303-646a2b56c079 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:42:17.022191 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-1960ec41-fd1b-4518-9303-646a2b56c079 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485d40bf82e421bafbb714c60c96df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430899def10d40c192f0d54b8ebf0af5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:42:17.028641 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-1960ec41-fd1b-4518-9303-646a2b56c079 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] 10.222.0.24 "GET /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91" status: 200 len: 1567 microversion: 2.1 time: 0.344404 May 19 13:42:17.029192 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 457/899] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:42:16 2022] GET /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91 => generated 1567 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:42:17.303551 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-e7cf3920-8f98-4a5e-87d4-306d4e46cfa1 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:42:17.304187 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-e7cf3920-8f98-4a5e-87d4-306d4e46cfa1 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: d4831f4e-33ee-459b-ac94-43ffe068e9fc] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:42:17.312117 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-e7cf3920-8f98-4a5e-87d4-306d4e46cfa1 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:42:17.312571 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-e7cf3920-8f98-4a5e-87d4-306d4e46cfa1 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:42:17.313359 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-e7cf3920-8f98-4a5e-87d4-306d4e46cfa1 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:42:17.313824 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-e7cf3920-8f98-4a5e-87d4-306d4e46cfa1 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:42:17.380125 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-e7cf3920-8f98-4a5e-87d4-306d4e46cfa1 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa4a2a39deb4e7ba54032acec14e029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc560e8b75194743bbb46d903b481357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:42:17.387857 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-e7cf3920-8f98-4a5e-87d4-306d4e46cfa1 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "GET /compute/v2.1/servers/d4831f4e-33ee-459b-ac94-43ffe068e9fc" status: 200 len: 1294 microversion: 2.1 time: 0.088763 May 19 13:42:17.388424 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 443/900] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:42:17 2022] GET /compute/v2.1/servers/d4831f4e-33ee-459b-ac94-43ffe068e9fc => generated 1294 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:42:18.048394 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-7107563f-431f-4d29-a62f-540937feb32d tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:42:18.049125 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-7107563f-431f-4d29-a62f-540937feb32d tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] [instance: b649c85b-1ed3-454b-8ca3-bb53ebc85d91] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:42:18.056343 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-7107563f-431f-4d29-a62f-540937feb32d tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:42:18.056787 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-7107563f-431f-4d29-a62f-540937feb32d tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:42:18.057587 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-7107563f-431f-4d29-a62f-540937feb32d tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:42:18.058069 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-7107563f-431f-4d29-a62f-540937feb32d tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:42:18.245966 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-7107563f-431f-4d29-a62f-540937feb32d tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485d40bf82e421bafbb714c60c96df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430899def10d40c192f0d54b8ebf0af5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:42:18.254581 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-7107563f-431f-4d29-a62f-540937feb32d tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] 10.222.0.24 "GET /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91" status: 200 len: 1567 microversion: 2.1 time: 0.210210 May 19 13:42:18.255141 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 458/901] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:42:18 2022] GET /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91 => generated 1567 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:42:18.408237 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-fabd1881-515a-4368-9769-70d8ff367302 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:42:18.408855 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-fabd1881-515a-4368-9769-70d8ff367302 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: d4831f4e-33ee-459b-ac94-43ffe068e9fc] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:42:18.415702 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-fabd1881-515a-4368-9769-70d8ff367302 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:42:18.416427 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-fabd1881-515a-4368-9769-70d8ff367302 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:42:18.417199 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-fabd1881-515a-4368-9769-70d8ff367302 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:42:18.417671 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-fabd1881-515a-4368-9769-70d8ff367302 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:42:18.559029 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-fabd1881-515a-4368-9769-70d8ff367302 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa4a2a39deb4e7ba54032acec14e029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc560e8b75194743bbb46d903b481357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:42:18.567867 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-fabd1881-515a-4368-9769-70d8ff367302 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "GET /compute/v2.1/servers/d4831f4e-33ee-459b-ac94-43ffe068e9fc" status: 200 len: 1367 microversion: 2.1 time: 0.163700 May 19 13:42:18.577928 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 444/902] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:42:18 2022] GET /compute/v2.1/servers/d4831f4e-33ee-459b-ac94-43ffe068e9fc => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:42:19.223748 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [req-82616e83-510b-4963-adea-52c9e76a8fb6 req-771e66ed-5e4c-41c4-8fb3-b7e4586bb0a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4831f4e-33ee-459b-ac94-43ffe068e9fc", "tag": "cfdcc325-e513-44bd-868d-d15c7db79c65"}]} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:42:19.233037 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-82616e83-510b-4963-adea-52c9e76a8fb6 req-771e66ed-5e4c-41c4-8fb3-b7e4586bb0a8 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:42:19.233497 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-82616e83-510b-4963-adea-52c9e76a8fb6 req-771e66ed-5e4c-41c4-8fb3-b7e4586bb0a8 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:42:19.247937 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.compute.server_external_events [req-82616e83-510b-4963-adea-52c9e76a8fb6 req-771e66ed-5e4c-41c4-8fb3-b7e4586bb0a8 service nova] Creating event network-changed:cfdcc325-e513-44bd-868d-d15c7db79c65 for instance d4831f4e-33ee-459b-ac94-43ffe068e9fc on hv-cinder-84112 May 19 13:42:19.254011 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [req-82616e83-510b-4963-adea-52c9e76a8fb6 req-771e66ed-5e4c-41c4-8fb3-b7e4586bb0a8 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107956 May 19 13:42:19.254765 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 459/903] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:42:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:42:19.272755 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-a20c1871-5726-495e-a20a-66ba3802fa4d tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:42:19.273514 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-a20c1871-5726-495e-a20a-66ba3802fa4d tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] [instance: b649c85b-1ed3-454b-8ca3-bb53ebc85d91] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:42:19.280050 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-a20c1871-5726-495e-a20a-66ba3802fa4d tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:42:19.280497 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-a20c1871-5726-495e-a20a-66ba3802fa4d tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:42:19.281273 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-a20c1871-5726-495e-a20a-66ba3802fa4d tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:42:19.281776 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-a20c1871-5726-495e-a20a-66ba3802fa4d tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:42:19.423387 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-a20c1871-5726-495e-a20a-66ba3802fa4d tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485d40bf82e421bafbb714c60c96df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430899def10d40c192f0d54b8ebf0af5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:42:19.431404 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-a20c1871-5726-495e-a20a-66ba3802fa4d tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] 10.222.0.24 "GET /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91" status: 200 len: 1567 microversion: 2.1 time: 0.163241 May 19 13:42:19.439692 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 445/904] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:42:19 2022] GET /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91 => generated 1567 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:42:19.585343 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-3548b358-9f50-4081-b2d4-74e912baadb2 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:42:19.586190 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-3548b358-9f50-4081-b2d4-74e912baadb2 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: d4831f4e-33ee-459b-ac94-43ffe068e9fc] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:42:19.592981 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-3548b358-9f50-4081-b2d4-74e912baadb2 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:42:19.593484 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-3548b358-9f50-4081-b2d4-74e912baadb2 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:42:19.594222 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-3548b358-9f50-4081-b2d4-74e912baadb2 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:42:19.594648 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-3548b358-9f50-4081-b2d4-74e912baadb2 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:42:19.733069 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-3548b358-9f50-4081-b2d4-74e912baadb2 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa4a2a39deb4e7ba54032acec14e029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc560e8b75194743bbb46d903b481357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:42:19.741357 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-3548b358-9f50-4081-b2d4-74e912baadb2 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "GET /compute/v2.1/servers/d4831f4e-33ee-459b-ac94-43ffe068e9fc" status: 200 len: 1367 microversion: 2.1 time: 0.160308 May 19 13:42:19.741967 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 460/905] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:42:19 2022] GET /compute/v2.1/servers/d4831f4e-33ee-459b-ac94-43ffe068e9fc => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:42:20.452405 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-7b938d8f-ed51-4088-b1d0-6b21d0e766bb tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:42:20.453378 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-7b938d8f-ed51-4088-b1d0-6b21d0e766bb tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] [instance: b649c85b-1ed3-454b-8ca3-bb53ebc85d91] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:42:20.462343 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-7b938d8f-ed51-4088-b1d0-6b21d0e766bb tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:42:20.462793 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-7b938d8f-ed51-4088-b1d0-6b21d0e766bb tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:42:20.463568 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-7b938d8f-ed51-4088-b1d0-6b21d0e766bb tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:42:20.463997 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-7b938d8f-ed51-4088-b1d0-6b21d0e766bb tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:42:20.597250 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-7b938d8f-ed51-4088-b1d0-6b21d0e766bb tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485d40bf82e421bafbb714c60c96df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430899def10d40c192f0d54b8ebf0af5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:42:20.606557 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-7b938d8f-ed51-4088-b1d0-6b21d0e766bb tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] 10.222.0.24 "GET /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91" status: 200 len: 1567 microversion: 2.1 time: 0.160638 May 19 13:42:20.607103 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 446/906] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:42:20 2022] GET /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:42:20.758299 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-f986569b-16dd-446a-8648-d3c2eba0ea4a tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:42:20.759106 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-f986569b-16dd-446a-8648-d3c2eba0ea4a tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: d4831f4e-33ee-459b-ac94-43ffe068e9fc] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:42:20.765946 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-f986569b-16dd-446a-8648-d3c2eba0ea4a tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:42:20.766397 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-f986569b-16dd-446a-8648-d3c2eba0ea4a tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:42:20.767242 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-f986569b-16dd-446a-8648-d3c2eba0ea4a tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:42:20.767678 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-f986569b-16dd-446a-8648-d3c2eba0ea4a tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:42:21.023117 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-f986569b-16dd-446a-8648-d3c2eba0ea4a tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa4a2a39deb4e7ba54032acec14e029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc560e8b75194743bbb46d903b481357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:42:21.030999 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-f986569b-16dd-446a-8648-d3c2eba0ea4a tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "GET /compute/v2.1/servers/d4831f4e-33ee-459b-ac94-43ffe068e9fc" status: 200 len: 1367 microversion: 2.1 time: 0.276915 May 19 13:42:21.031559 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 461/907] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:42:20 2022] GET /compute/v2.1/servers/d4831f4e-33ee-459b-ac94-43ffe068e9fc => generated 1367 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:42:21.627932 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-81debee0-1402-481e-b5ae-a35c53b2020f tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:42:21.628799 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-81debee0-1402-481e-b5ae-a35c53b2020f tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] [instance: b649c85b-1ed3-454b-8ca3-bb53ebc85d91] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:42:21.636745 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-81debee0-1402-481e-b5ae-a35c53b2020f tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:42:21.637175 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-81debee0-1402-481e-b5ae-a35c53b2020f tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:42:21.638016 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-81debee0-1402-481e-b5ae-a35c53b2020f tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:42:21.638448 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-81debee0-1402-481e-b5ae-a35c53b2020f tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:42:21.777576 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-81debee0-1402-481e-b5ae-a35c53b2020f tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485d40bf82e421bafbb714c60c96df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430899def10d40c192f0d54b8ebf0af5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:42:21.790038 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-81debee0-1402-481e-b5ae-a35c53b2020f tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] 10.222.0.24 "GET /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91" status: 200 len: 1567 microversion: 2.1 time: 0.168430 May 19 13:42:21.790904 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 447/908] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:42:21 2022] GET /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91 => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:42:22.053200 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-5a9e1a74-fa28-488d-babf-db53b6545b21 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:42:22.054415 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-5a9e1a74-fa28-488d-babf-db53b6545b21 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: d4831f4e-33ee-459b-ac94-43ffe068e9fc] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:42:22.065699 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-5a9e1a74-fa28-488d-babf-db53b6545b21 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:42:22.066463 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-5a9e1a74-fa28-488d-babf-db53b6545b21 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:42:22.067745 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-5a9e1a74-fa28-488d-babf-db53b6545b21 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:42:22.068547 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-5a9e1a74-fa28-488d-babf-db53b6545b21 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:42:22.220539 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-5a9e1a74-fa28-488d-babf-db53b6545b21 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa4a2a39deb4e7ba54032acec14e029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc560e8b75194743bbb46d903b481357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:42:22.229567 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-5a9e1a74-fa28-488d-babf-db53b6545b21 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "GET /compute/v2.1/servers/d4831f4e-33ee-459b-ac94-43ffe068e9fc" status: 200 len: 1367 microversion: 2.1 time: 0.182975 May 19 13:42:22.230110 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 462/909] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:42:22 2022] GET /compute/v2.1/servers/d4831f4e-33ee-459b-ac94-43ffe068e9fc => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:42:22.812341 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-33dda932-04db-4f68-8fc1-337dd5edd6bd tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:42:22.813151 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-33dda932-04db-4f68-8fc1-337dd5edd6bd tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] [instance: b649c85b-1ed3-454b-8ca3-bb53ebc85d91] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:42:22.820426 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-33dda932-04db-4f68-8fc1-337dd5edd6bd tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:42:22.820876 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-33dda932-04db-4f68-8fc1-337dd5edd6bd tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:42:22.821678 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-33dda932-04db-4f68-8fc1-337dd5edd6bd tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:42:22.822107 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-33dda932-04db-4f68-8fc1-337dd5edd6bd tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:42:22.958120 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [req-69874f29-e78b-45a8-ae02-941006729dcd req-8a6a70d5-a2b8-4bd1-bce9-b856972e75c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4831f4e-33ee-459b-ac94-43ffe068e9fc", "name": "network-vif-plugged", "status": "completed", "tag": "cfdcc325-e513-44bd-868d-d15c7db79c65"}]} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:42:22.968409 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-33dda932-04db-4f68-8fc1-337dd5edd6bd tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485d40bf82e421bafbb714c60c96df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430899def10d40c192f0d54b8ebf0af5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:42:22.969881 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-69874f29-e78b-45a8-ae02-941006729dcd req-8a6a70d5-a2b8-4bd1-bce9-b856972e75c0 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:42:22.970328 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-69874f29-e78b-45a8-ae02-941006729dcd req-8a6a70d5-a2b8-4bd1-bce9-b856972e75c0 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:42:22.976507 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-33dda932-04db-4f68-8fc1-337dd5edd6bd tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] 10.222.0.24 "GET /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91" status: 200 len: 1567 microversion: 2.1 time: 0.168146 May 19 13:42:22.977085 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 448/910] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:42:22 2022] GET /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91 => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:42:22.984622 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.compute.server_external_events [req-69874f29-e78b-45a8-ae02-941006729dcd req-8a6a70d5-a2b8-4bd1-bce9-b856972e75c0 service nova] Creating event network-vif-plugged:cfdcc325-e513-44bd-868d-d15c7db79c65 for instance d4831f4e-33ee-459b-ac94-43ffe068e9fc on hv-cinder-84112 May 19 13:42:22.989561 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [req-69874f29-e78b-45a8-ae02-941006729dcd req-8a6a70d5-a2b8-4bd1-bce9-b856972e75c0 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101520 May 19 13:42:22.990427 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 463/911] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:42:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 13:42:23.246805 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-80a4be70-c45e-4943-ae9c-c532b4a13578 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:42:23.247403 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-80a4be70-c45e-4943-ae9c-c532b4a13578 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: d4831f4e-33ee-459b-ac94-43ffe068e9fc] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:42:23.253537 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-80a4be70-c45e-4943-ae9c-c532b4a13578 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:42:23.253984 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-80a4be70-c45e-4943-ae9c-c532b4a13578 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:42:23.254766 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-80a4be70-c45e-4943-ae9c-c532b4a13578 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:42:23.255194 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-80a4be70-c45e-4943-ae9c-c532b4a13578 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:42:23.394444 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-80a4be70-c45e-4943-ae9c-c532b4a13578 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa4a2a39deb4e7ba54032acec14e029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc560e8b75194743bbb46d903b481357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:42:23.402743 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-80a4be70-c45e-4943-ae9c-c532b4a13578 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "GET /compute/v2.1/servers/d4831f4e-33ee-459b-ac94-43ffe068e9fc" status: 200 len: 1367 microversion: 2.1 time: 0.159830 May 19 13:42:23.403305 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 449/912] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:42:23 2022] GET /compute/v2.1/servers/d4831f4e-33ee-459b-ac94-43ffe068e9fc => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:42:23.996225 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-c2108bc6-b439-477b-8a3c-d82c3817da89 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:42:23.996910 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-c2108bc6-b439-477b-8a3c-d82c3817da89 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] [instance: b649c85b-1ed3-454b-8ca3-bb53ebc85d91] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:42:24.003599 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-c2108bc6-b439-477b-8a3c-d82c3817da89 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:42:24.004065 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-c2108bc6-b439-477b-8a3c-d82c3817da89 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:42:24.004823 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-c2108bc6-b439-477b-8a3c-d82c3817da89 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:42:24.005251 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-c2108bc6-b439-477b-8a3c-d82c3817da89 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:42:24.143234 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-c2108bc6-b439-477b-8a3c-d82c3817da89 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485d40bf82e421bafbb714c60c96df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430899def10d40c192f0d54b8ebf0af5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:42:24.151186 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-c2108bc6-b439-477b-8a3c-d82c3817da89 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] 10.222.0.24 "GET /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91" status: 200 len: 1567 microversion: 2.1 time: 0.159815 May 19 13:42:24.151812 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 464/913] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:42:23 2022] GET /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:42:24.424226 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-3250cd89-1ccb-4a2f-9837-f2477f97ba27 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:42:24.425112 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-3250cd89-1ccb-4a2f-9837-f2477f97ba27 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: d4831f4e-33ee-459b-ac94-43ffe068e9fc] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:42:24.436873 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-3250cd89-1ccb-4a2f-9837-f2477f97ba27 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:42:24.437668 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-3250cd89-1ccb-4a2f-9837-f2477f97ba27 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:42:24.438903 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-3250cd89-1ccb-4a2f-9837-f2477f97ba27 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:42:24.439672 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-3250cd89-1ccb-4a2f-9837-f2477f97ba27 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:42:24.573913 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-3250cd89-1ccb-4a2f-9837-f2477f97ba27 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa4a2a39deb4e7ba54032acec14e029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc560e8b75194743bbb46d903b481357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:42:24.581836 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-3250cd89-1ccb-4a2f-9837-f2477f97ba27 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "GET /compute/v2.1/servers/d4831f4e-33ee-459b-ac94-43ffe068e9fc" status: 200 len: 1556 microversion: 2.1 time: 0.164655 May 19 13:42:24.582401 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 450/914] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:42:24 2022] GET /compute/v2.1/servers/d4831f4e-33ee-459b-ac94-43ffe068e9fc => generated 1556 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:42:24.604074 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-0633f088-e38e-4aac-9a9f-0237c1249fc1 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:42:24.604565 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-0633f088-e38e-4aac-9a9f-0237c1249fc1 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: d4831f4e-33ee-459b-ac94-43ffe068e9fc] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:42:24.611093 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-0633f088-e38e-4aac-9a9f-0237c1249fc1 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:42:24.611544 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-0633f088-e38e-4aac-9a9f-0237c1249fc1 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:42:24.612308 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-0633f088-e38e-4aac-9a9f-0237c1249fc1 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:42:24.612742 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-0633f088-e38e-4aac-9a9f-0237c1249fc1 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:42:24.698661 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-0633f088-e38e-4aac-9a9f-0237c1249fc1 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "GET /compute/v2.1/servers/d4831f4e-33ee-459b-ac94-43ffe068e9fc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098440 May 19 13:42:24.699432 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 465/915] 10.222.0.24 () {58 vars in 1274 bytes} [Thu May 19 13:42:24 2022] GET /compute/v2.1/servers/d4831f4e-33ee-459b-ac94-43ffe068e9fc/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:42:25.169048 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-da6d8d64-f00c-4c38-a78c-63607a6fa276 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:42:25.169743 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-da6d8d64-f00c-4c38-a78c-63607a6fa276 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] [instance: b649c85b-1ed3-454b-8ca3-bb53ebc85d91] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:42:25.176256 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-da6d8d64-f00c-4c38-a78c-63607a6fa276 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:42:25.176691 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-da6d8d64-f00c-4c38-a78c-63607a6fa276 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:42:25.177486 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-da6d8d64-f00c-4c38-a78c-63607a6fa276 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:42:25.177952 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-da6d8d64-f00c-4c38-a78c-63607a6fa276 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:42:25.320138 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-da6d8d64-f00c-4c38-a78c-63607a6fa276 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485d40bf82e421bafbb714c60c96df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430899def10d40c192f0d54b8ebf0af5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:42:25.328268 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-da6d8d64-f00c-4c38-a78c-63607a6fa276 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] 10.222.0.24 "GET /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91" status: 200 len: 1567 microversion: 2.1 time: 0.163815 May 19 13:42:25.328813 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 451/916] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:42:25 2022] GET /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91 => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:42:25.640720 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [req-b38bad48-04a9-4f82-863c-2f7603a86bee req-bceae1fe-e626-453c-8599-d53974290d7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4831f4e-33ee-459b-ac94-43ffe068e9fc", "tag": "cfdcc325-e513-44bd-868d-d15c7db79c65"}]} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:42:25.649928 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-b38bad48-04a9-4f82-863c-2f7603a86bee req-bceae1fe-e626-453c-8599-d53974290d7e service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:42:25.650453 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-b38bad48-04a9-4f82-863c-2f7603a86bee req-bceae1fe-e626-453c-8599-d53974290d7e service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:42:25.661533 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.compute.server_external_events [req-b38bad48-04a9-4f82-863c-2f7603a86bee req-bceae1fe-e626-453c-8599-d53974290d7e service nova] Creating event network-changed:cfdcc325-e513-44bd-868d-d15c7db79c65 for instance d4831f4e-33ee-459b-ac94-43ffe068e9fc on hv-cinder-84112 May 19 13:42:25.667000 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [req-b38bad48-04a9-4f82-863c-2f7603a86bee req-bceae1fe-e626-453c-8599-d53974290d7e service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030477 May 19 13:42:25.667802 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 466/917] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:42:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:42:26.345842 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-8bffe93e-f09c-463d-9c50-bc593122c4b6 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:42:26.346425 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-8bffe93e-f09c-463d-9c50-bc593122c4b6 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] [instance: b649c85b-1ed3-454b-8ca3-bb53ebc85d91] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:42:26.352622 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_cell0:SELECT=6 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:42:26.354959 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-8bffe93e-f09c-463d-9c50-bc593122c4b6 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:42:26.355384 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-8bffe93e-f09c-463d-9c50-bc593122c4b6 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:42:26.356208 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-8bffe93e-f09c-463d-9c50-bc593122c4b6 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:42:26.356688 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-8bffe93e-f09c-463d-9c50-bc593122c4b6 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:42:26.496769 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-8bffe93e-f09c-463d-9c50-bc593122c4b6 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485d40bf82e421bafbb714c60c96df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430899def10d40c192f0d54b8ebf0af5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:42:26.505352 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-8bffe93e-f09c-463d-9c50-bc593122c4b6 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] 10.222.0.24 "GET /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91" status: 200 len: 1567 microversion: 2.1 time: 0.163560 May 19 13:42:26.506076 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 452/918] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:42:26 2022] GET /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91 => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:42:27.528906 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-7742eeb5-1424-42ef-a038-4d386f034a09 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:42:27.531132 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-7742eeb5-1424-42ef-a038-4d386f034a09 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] [instance: b649c85b-1ed3-454b-8ca3-bb53ebc85d91] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:42:27.534248 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_cell0:SELECT=2 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:42:27.535395 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_cell0:SELECT=6 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:42:27.543949 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-7742eeb5-1424-42ef-a038-4d386f034a09 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:42:27.544399 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-7742eeb5-1424-42ef-a038-4d386f034a09 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:42:27.545174 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-7742eeb5-1424-42ef-a038-4d386f034a09 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:42:27.545644 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-7742eeb5-1424-42ef-a038-4d386f034a09 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:42:27.700605 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-7742eeb5-1424-42ef-a038-4d386f034a09 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485d40bf82e421bafbb714c60c96df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430899def10d40c192f0d54b8ebf0af5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:42:27.708626 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-7742eeb5-1424-42ef-a038-4d386f034a09 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] 10.222.0.24 "GET /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91" status: 200 len: 1567 microversion: 2.1 time: 0.187719 May 19 13:42:27.709357 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 467/919] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:42:27 2022] GET /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91 => generated 1567 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:42:28.726471 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-9e71c9a7-066a-45a0-970e-1e491476e41b tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:42:28.727256 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-9e71c9a7-066a-45a0-970e-1e491476e41b tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] [instance: b649c85b-1ed3-454b-8ca3-bb53ebc85d91] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:42:28.734469 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-9e71c9a7-066a-45a0-970e-1e491476e41b tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:42:28.735199 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-9e71c9a7-066a-45a0-970e-1e491476e41b tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:42:28.735948 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-9e71c9a7-066a-45a0-970e-1e491476e41b tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:42:28.736585 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-9e71c9a7-066a-45a0-970e-1e491476e41b tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:42:28.865672 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-9e71c9a7-066a-45a0-970e-1e491476e41b tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485d40bf82e421bafbb714c60c96df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430899def10d40c192f0d54b8ebf0af5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:42:28.873366 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-9e71c9a7-066a-45a0-970e-1e491476e41b tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] 10.222.0.24 "GET /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91" status: 200 len: 1508 microversion: 2.1 time: 0.150954 May 19 13:42:28.874154 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 453/920] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:42:28 2022] GET /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91 => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:42:28.890556 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-4ead16c8-9ec4-40e6-aad4-fd93bc32ae60 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:42:28.891158 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-4ead16c8-9ec4-40e6-aad4-fd93bc32ae60 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] [instance: b649c85b-1ed3-454b-8ca3-bb53ebc85d91] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:42:28.897737 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-4ead16c8-9ec4-40e6-aad4-fd93bc32ae60 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:42:28.898176 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-4ead16c8-9ec4-40e6-aad4-fd93bc32ae60 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:42:28.898918 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-4ead16c8-9ec4-40e6-aad4-fd93bc32ae60 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:42:28.899341 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-4ead16c8-9ec4-40e6-aad4-fd93bc32ae60 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:42:28.984799 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-4ead16c8-9ec4-40e6-aad4-fd93bc32ae60 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] 10.222.0.24 "POST /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91/action" status: 202 len: 0 microversion: 2.1 time: 0.098250 May 19 13:42:28.985403 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 468/921] 10.222.0.24 () {60 vars in 1277 bytes} [Thu May 19 13:42:28 2022] POST /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 13:42:28.993814 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-437d507a-3f8c-4105-9976-b8d24c159dc8 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:42:28.994589 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-437d507a-3f8c-4105-9976-b8d24c159dc8 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] [instance: b649c85b-1ed3-454b-8ca3-bb53ebc85d91] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:42:29.000819 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-437d507a-3f8c-4105-9976-b8d24c159dc8 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:42:29.001356 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-437d507a-3f8c-4105-9976-b8d24c159dc8 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:42:29.002343 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-437d507a-3f8c-4105-9976-b8d24c159dc8 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:42:29.002791 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-437d507a-3f8c-4105-9976-b8d24c159dc8 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:42:29.168904 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-437d507a-3f8c-4105-9976-b8d24c159dc8 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485d40bf82e421bafbb714c60c96df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430899def10d40c192f0d54b8ebf0af5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:42:29.177057 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-437d507a-3f8c-4105-9976-b8d24c159dc8 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] 10.222.0.24 "GET /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91" status: 200 len: 1516 microversion: 2.1 time: 0.187397 May 19 13:42:29.177655 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 454/922] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:42:28 2022] GET /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91 => generated 1516 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:42:30.198657 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-dec464b0-e273-49ab-ab2e-38dc4ea68fad tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:42:30.199231 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-dec464b0-e273-49ab-ab2e-38dc4ea68fad tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] [instance: b649c85b-1ed3-454b-8ca3-bb53ebc85d91] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:42:30.206193 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-dec464b0-e273-49ab-ab2e-38dc4ea68fad tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:42:30.206645 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-dec464b0-e273-49ab-ab2e-38dc4ea68fad tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:42:30.207450 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-dec464b0-e273-49ab-ab2e-38dc4ea68fad tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:42:30.207888 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-dec464b0-e273-49ab-ab2e-38dc4ea68fad tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:42:30.212003 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:42:30.348851 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-dec464b0-e273-49ab-ab2e-38dc4ea68fad tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485d40bf82e421bafbb714c60c96df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430899def10d40c192f0d54b8ebf0af5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:42:30.358727 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-dec464b0-e273-49ab-ab2e-38dc4ea68fad tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] 10.222.0.24 "GET /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91" status: 200 len: 1518 microversion: 2.1 time: 0.166182 May 19 13:42:30.359657 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 469/923] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:42:30 2022] GET /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91 => generated 1518 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:42:31.376426 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-06e963c5-d89a-4cda-961d-1821aa1123bc tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:42:31.376993 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-06e963c5-d89a-4cda-961d-1821aa1123bc tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] [instance: b649c85b-1ed3-454b-8ca3-bb53ebc85d91] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:42:31.384071 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-06e963c5-d89a-4cda-961d-1821aa1123bc tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:42:31.384510 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-06e963c5-d89a-4cda-961d-1821aa1123bc tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:42:31.385263 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-06e963c5-d89a-4cda-961d-1821aa1123bc tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:42:31.385750 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-06e963c5-d89a-4cda-961d-1821aa1123bc tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:42:31.528376 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-06e963c5-d89a-4cda-961d-1821aa1123bc tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485d40bf82e421bafbb714c60c96df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430899def10d40c192f0d54b8ebf0af5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:42:31.536283 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-06e963c5-d89a-4cda-961d-1821aa1123bc tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] 10.222.0.24 "GET /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91" status: 200 len: 1574 microversion: 2.1 time: 0.163885 May 19 13:42:31.537045 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 455/924] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:42:31 2022] GET /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91 => generated 1574 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:42:32.559024 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-72811c6c-cc53-4b08-83bc-f946b19baa99 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:42:32.559903 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-72811c6c-cc53-4b08-83bc-f946b19baa99 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] [instance: b649c85b-1ed3-454b-8ca3-bb53ebc85d91] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:42:32.571123 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-72811c6c-cc53-4b08-83bc-f946b19baa99 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:42:32.571886 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-72811c6c-cc53-4b08-83bc-f946b19baa99 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:42:32.573269 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-72811c6c-cc53-4b08-83bc-f946b19baa99 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:42:32.574321 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-72811c6c-cc53-4b08-83bc-f946b19baa99 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:42:32.725096 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-72811c6c-cc53-4b08-83bc-f946b19baa99 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485d40bf82e421bafbb714c60c96df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430899def10d40c192f0d54b8ebf0af5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:42:32.734980 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-72811c6c-cc53-4b08-83bc-f946b19baa99 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] 10.222.0.24 "GET /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91" status: 200 len: 1574 microversion: 2.1 time: 0.183662 May 19 13:42:32.735542 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 470/925] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:42:32 2022] GET /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91 => generated 1574 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:42:32.889144 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [req-b32b2604-8ce8-4485-b619-74d1a125c74f req-1da73662-9d16-4723-804c-63bea91ff297 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b649c85b-1ed3-454b-8ca3-bb53ebc85d91", "name": "network-vif-unplugged", "status": "completed", "tag": "5d430264-4bd6-4eeb-8a94-9063eff662ea"}]} {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:42:32.899379 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [req-b32b2604-8ce8-4485-b619-74d1a125c74f req-1da73662-9d16-4723-804c-63bea91ff297 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:42:32.899820 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [req-b32b2604-8ce8-4485-b619-74d1a125c74f req-1da73662-9d16-4723-804c-63bea91ff297 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:42:32.914635 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.compute.server_external_events [req-b32b2604-8ce8-4485-b619-74d1a125c74f req-1da73662-9d16-4723-804c-63bea91ff297 service nova] Creating event network-vif-unplugged:5d430264-4bd6-4eeb-8a94-9063eff662ea for instance b649c85b-1ed3-454b-8ca3-bb53ebc85d91 on hv-cinder-84112 May 19 13:42:32.920594 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [req-b32b2604-8ce8-4485-b619-74d1a125c74f req-1da73662-9d16-4723-804c-63bea91ff297 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035295 May 19 13:42:32.921624 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 456/926] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:42:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:42:33.752447 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-3da07f87-4176-4e20-b9f3-316608ea112a tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:42:33.753108 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-3da07f87-4176-4e20-b9f3-316608ea112a tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] [instance: b649c85b-1ed3-454b-8ca3-bb53ebc85d91] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:42:33.760049 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-3da07f87-4176-4e20-b9f3-316608ea112a tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:42:33.760552 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-3da07f87-4176-4e20-b9f3-316608ea112a tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:42:33.761649 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-3da07f87-4176-4e20-b9f3-316608ea112a tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:42:33.762083 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-3da07f87-4176-4e20-b9f3-316608ea112a tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:42:33.906102 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-3da07f87-4176-4e20-b9f3-316608ea112a tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485d40bf82e421bafbb714c60c96df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430899def10d40c192f0d54b8ebf0af5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:42:33.914436 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-3da07f87-4176-4e20-b9f3-316608ea112a tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] 10.222.0.24 "GET /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91" status: 200 len: 1574 microversion: 2.1 time: 0.166048 May 19 13:42:33.915004 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 471/927] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:42:33 2022] GET /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91 => generated 1574 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:42:34.937378 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-2ccffb20-de20-436b-a437-2f2ffdf656c1 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:42:34.938392 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-2ccffb20-de20-436b-a437-2f2ffdf656c1 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] [instance: b649c85b-1ed3-454b-8ca3-bb53ebc85d91] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:42:34.942316 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=1 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:42:34.950645 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-2ccffb20-de20-436b-a437-2f2ffdf656c1 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:42:34.951134 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-2ccffb20-de20-436b-a437-2f2ffdf656c1 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:42:34.951928 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-2ccffb20-de20-436b-a437-2f2ffdf656c1 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:42:34.952388 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-2ccffb20-de20-436b-a437-2f2ffdf656c1 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:42:35.095272 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-2ccffb20-de20-436b-a437-2f2ffdf656c1 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485d40bf82e421bafbb714c60c96df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430899def10d40c192f0d54b8ebf0af5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:42:35.109060 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-2ccffb20-de20-436b-a437-2f2ffdf656c1 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] 10.222.0.24 "GET /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91" status: 200 len: 1574 microversion: 2.1 time: 0.178703 May 19 13:42:35.109996 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 457/928] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:42:34 2022] GET /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91 => generated 1574 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:42:36.135043 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-5bdc8672-545b-4932-997b-6b201512f578 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:42:36.135996 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-5bdc8672-545b-4932-997b-6b201512f578 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] [instance: b649c85b-1ed3-454b-8ca3-bb53ebc85d91] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:42:36.144210 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-5bdc8672-545b-4932-997b-6b201512f578 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:42:36.144666 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-5bdc8672-545b-4932-997b-6b201512f578 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:42:36.145445 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-5bdc8672-545b-4932-997b-6b201512f578 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:42:36.145903 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-5bdc8672-545b-4932-997b-6b201512f578 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:42:36.284360 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-5bdc8672-545b-4932-997b-6b201512f578 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485d40bf82e421bafbb714c60c96df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430899def10d40c192f0d54b8ebf0af5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:42:36.292288 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-5bdc8672-545b-4932-997b-6b201512f578 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] 10.222.0.24 "GET /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91" status: 200 len: 1574 microversion: 2.1 time: 0.164017 May 19 13:42:36.292854 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 472/929] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:42:36 2022] GET /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91 => generated 1574 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:42:37.312939 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-2a826a61-4500-45dd-94c5-507a25a3e03e tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:42:37.313804 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-2a826a61-4500-45dd-94c5-507a25a3e03e tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] [instance: b649c85b-1ed3-454b-8ca3-bb53ebc85d91] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:42:37.322892 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-2a826a61-4500-45dd-94c5-507a25a3e03e tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:42:37.323512 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-2a826a61-4500-45dd-94c5-507a25a3e03e tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:42:37.324528 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-2a826a61-4500-45dd-94c5-507a25a3e03e tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:42:37.325214 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-2a826a61-4500-45dd-94c5-507a25a3e03e tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:42:37.458449 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-2a826a61-4500-45dd-94c5-507a25a3e03e tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485d40bf82e421bafbb714c60c96df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430899def10d40c192f0d54b8ebf0af5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:42:37.466172 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-2a826a61-4500-45dd-94c5-507a25a3e03e tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] 10.222.0.24 "GET /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91" status: 200 len: 1574 microversion: 2.1 time: 0.158948 May 19 13:42:37.466745 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 458/930] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:42:37 2022] GET /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91 => generated 1574 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:42:38.491113 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-d1303c5c-24a8-420f-a475-a6af78dddafe tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:42:38.492097 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-d1303c5c-24a8-420f-a475-a6af78dddafe tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] [instance: b649c85b-1ed3-454b-8ca3-bb53ebc85d91] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:42:38.496052 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:42:38.502445 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-d1303c5c-24a8-420f-a475-a6af78dddafe tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:42:38.502890 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-d1303c5c-24a8-420f-a475-a6af78dddafe tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:42:38.503658 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-d1303c5c-24a8-420f-a475-a6af78dddafe tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:42:38.504093 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-d1303c5c-24a8-420f-a475-a6af78dddafe tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:42:38.643132 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-d1303c5c-24a8-420f-a475-a6af78dddafe tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485d40bf82e421bafbb714c60c96df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430899def10d40c192f0d54b8ebf0af5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:42:38.654237 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-d1303c5c-24a8-420f-a475-a6af78dddafe tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] 10.222.0.24 "GET /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91" status: 200 len: 1574 microversion: 2.1 time: 0.173254 May 19 13:42:38.654803 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 473/931] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:42:38 2022] GET /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91 => generated 1574 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:42:39.672192 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-c40fe3b5-b7c6-4e98-9c0b-6bb40bb53fab tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:42:39.672941 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-c40fe3b5-b7c6-4e98-9c0b-6bb40bb53fab tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] [instance: b649c85b-1ed3-454b-8ca3-bb53ebc85d91] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:42:39.679922 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-c40fe3b5-b7c6-4e98-9c0b-6bb40bb53fab tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:42:39.680289 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-c40fe3b5-b7c6-4e98-9c0b-6bb40bb53fab tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:42:39.681039 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-c40fe3b5-b7c6-4e98-9c0b-6bb40bb53fab tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:42:39.681451 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-c40fe3b5-b7c6-4e98-9c0b-6bb40bb53fab tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:42:39.685439 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_cell1:SELECT=100 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:42:39.818416 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-c40fe3b5-b7c6-4e98-9c0b-6bb40bb53fab tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485d40bf82e421bafbb714c60c96df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430899def10d40c192f0d54b8ebf0af5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:42:39.826420 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-c40fe3b5-b7c6-4e98-9c0b-6bb40bb53fab tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] 10.222.0.24 "GET /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91" status: 200 len: 1561 microversion: 2.1 time: 0.158949 May 19 13:42:39.826988 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 459/932] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:42:39 2022] GET /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91 => generated 1561 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:42:41.017685 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [req-310f0db0-5f80-4b1e-8d34-4b208628c0a3 req-c1689e51-7837-4adc-8a46-5e60f0e16b05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b649c85b-1ed3-454b-8ca3-bb53ebc85d91", "name": "network-vif-plugged", "status": "completed", "tag": "5d430264-4bd6-4eeb-8a94-9063eff662ea"}]} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:42:41.026185 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-310f0db0-5f80-4b1e-8d34-4b208628c0a3 req-c1689e51-7837-4adc-8a46-5e60f0e16b05 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:42:41.026629 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-310f0db0-5f80-4b1e-8d34-4b208628c0a3 req-c1689e51-7837-4adc-8a46-5e60f0e16b05 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:42:41.038187 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.compute.server_external_events [req-310f0db0-5f80-4b1e-8d34-4b208628c0a3 req-c1689e51-7837-4adc-8a46-5e60f0e16b05 service nova] Creating event network-vif-plugged:5d430264-4bd6-4eeb-8a94-9063eff662ea for instance b649c85b-1ed3-454b-8ca3-bb53ebc85d91 on hv-cinder-84112 May 19 13:42:41.043659 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [req-310f0db0-5f80-4b1e-8d34-4b208628c0a3 req-c1689e51-7837-4adc-8a46-5e60f0e16b05 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029879 May 19 13:42:41.044264 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 474/933] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:42:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:43:01.804978 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-7879138f-9513-4ff1-bdd4-7258006989b2 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:43:01.805627 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-7879138f-9513-4ff1-bdd4-7258006989b2 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: d4831f4e-33ee-459b-ac94-43ffe068e9fc] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:43:01.808016 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_api:SELECT=5 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:43:01.809316 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_cell1:SELECT=4 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:43:01.815621 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-7879138f-9513-4ff1-bdd4-7258006989b2 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:01.816070 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-7879138f-9513-4ff1-bdd4-7258006989b2 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:01.816849 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-7879138f-9513-4ff1-bdd4-7258006989b2 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:01.817271 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-7879138f-9513-4ff1-bdd4-7258006989b2 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:01.844116 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-7879138f-9513-4ff1-bdd4-7258006989b2 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "GET /compute/v2.1/servers/d4831f4e-33ee-459b-ac94-43ffe068e9fc/ips" status: 200 len: 149 microversion: 2.1 time: 0.043432 May 19 13:43:01.844698 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 460/934] 10.222.0.24 () {58 vars in 1247 bytes} [Thu May 19 13:43:01 2022] GET /compute/v2.1/servers/d4831f4e-33ee-459b-ac94-43ffe068e9fc/ips => generated 149 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:43:01.853906 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_api:SELECT=3 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:43:01.854717 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_cell1:SELECT=30 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:43:01.859015 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-a665f188-738f-49a7-802d-e2ca7c36e146 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c333af7f-6171-4962-9180-9e563704adf0"}} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:43:01.860486 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-a665f188-738f-49a7-802d-e2ca7c36e146 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: d4831f4e-33ee-459b-ac94-43ffe068e9fc] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:43:01.867460 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-a665f188-738f-49a7-802d-e2ca7c36e146 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:01.867902 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-a665f188-738f-49a7-802d-e2ca7c36e146 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:01.868658 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-a665f188-738f-49a7-802d-e2ca7c36e146 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:01.869188 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-a665f188-738f-49a7-802d-e2ca7c36e146 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:01.949478 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.wsgi [None req-a665f188-738f-49a7-802d-e2ca7c36e146 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] HTTP exception thrown: Invalid volume: volume c333af7f-6171-4962-9180-9e563704adf0 is already attached to instances: fbe881d3-e162-43fb-a5d8-0c954d016ad3 May 19 13:43:01.951421 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-a665f188-738f-49a7-802d-e2ca7c36e146 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Request method failure captured: May 19 13:43:01.951421 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: request: POST /compute/v2.1/servers/d4831f4e-33ee-459b-ac94-43ffe068e9fc/os-volume_attachments HTTP/1.1 May 19 13:43:01.951421 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Accept: application/json May 19 13:43:01.951421 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Accept-Encoding: identity May 19 13:43:01.951421 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Connection: close May 19 13:43:01.951421 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Content-Length: 74 May 19 13:43:01.951421 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Content-Type: application/json May 19 13:43:01.951421 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Host: 10.222.0.24 May 19 13:43:01.951421 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Openstack-System-Scope: None May 19 13:43:01.951421 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: User-Agent: python-urllib3/1.26.9 May 19 13:43:01.951421 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Auth-Token: gAAAAABihkj6liBLvukkw2qtst-UG_cKJZiNcCgt6W_kQDYluV0QF-s3L61GELG86yuBU_XP0oEocHGYFB77RCnoJWx_PSe5oCa2SU8RfG2VbbO9_x7MK34OtxqKFCLvWQmkpMAhKbbulm_ByBEFHwsuhM1s6duzmOYoRlcr_Dq0_GCOhJ038Nk May 19 13:43:01.951421 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Domain-Id: None May 19 13:43:01.951421 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Domain-Name: None May 19 13:43:01.951421 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Identity-Status: Confirmed May 19 13:43:01.951421 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Is-Admin-Project: True May 19 13:43:01.951421 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Domain-Id: default May 19 13:43:01.951421 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Domain-Name: Default May 19 13:43:01.951421 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Id: bc560e8b75194743bbb46d903b481357 May 19 13:43:01.951421 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Name: tempest-AttachVolumeNegativeTest-35839424 May 19 13:43:01.951421 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Role: reader,member May 19 13:43:01.951421 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Roles: reader,member May 19 13:43:01.952897 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/bc560e8b75194743bbb46d903b481357"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/bc560e8b75194743bbb46d903b481357"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_bc560e8b75194743bbb46d903b481357", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/bc560e8b75194743bbb46d903b481357"}]}] May 19 13:43:01.952897 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Tenant: tempest-AttachVolumeNegativeTest-35839424 May 19 13:43:01.952897 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Tenant-Id: bc560e8b75194743bbb46d903b481357 May 19 13:43:01.952897 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-35839424 May 19 13:43:01.952897 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User: tempest-AttachVolumeNegativeTest-35839424-project May 19 13:43:01.952897 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Domain-Id: default May 19 13:43:01.952897 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Domain-Name: Default May 19 13:43:01.952897 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Id: daa4a2a39deb4e7ba54032acec14e029 May 19 13:43:01.952897 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Name: tempest-AttachVolumeNegativeTest-35839424-project May 19 13:43:01.952897 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: May 19 13:43:01.952897 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: {"volumeAttachment": {"volumeId": "c333af7f-6171-4962-9180-9e563704adf0"}} May 19 13:43:01.952897 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: method: > May 19 13:43:01.955040 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: exception: Invalid volume: volume c333af7f-6171-4962-9180-9e563704adf0 is already attached to instances: fbe881d3-e162-43fb-a5d8-0c954d016ad3 May 19 13:43:01.955040 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: action_args: {'server_id': 'd4831f4e-33ee-459b-ac94-43ffe068e9fc', 'body': {'volumeAttachment': {'volumeId': 'c333af7f-6171-4962-9180-9e563704adf0'}}} May 19 13:43:01.955040 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:43:01.955040 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:43:01.955040 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 19 13:43:01.955040 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 19 13:43:01.955040 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 19 13:43:01.955040 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 13:43:01.955040 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 19 13:43:01.955040 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 19 13:43:01.955040 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 19 13:43:01.955040 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 19 13:43:01.955040 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 19 13:43:01.955040 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 19 13:43:01.955040 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume c333af7f-6171-4962-9180-9e563704adf0 is already attached to instances: fbe881d3-e162-43fb-a5d8-0c954d016ad3 May 19 13:43:01.955040 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:43:01.955040 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:43:01.955040 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:43:01.955040 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:43:01.958391 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:43:01.958391 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:43:01.958391 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:43:01.958391 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:43:01.958391 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:43:01.958391 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:43:01.958391 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 13:43:01.958391 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 13:43:01.958391 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 13:43:01.958391 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 13:43:01.958391 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 13:43:01.958391 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 13:43:01.958391 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 19 13:43:01.958391 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 19 13:43:01.958391 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume c333af7f-6171-4962-9180-9e563704adf0 is already attached to instances: fbe881d3-e162-43fb-a5d8-0c954d016ad3 May 19 13:43:01.958391 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:43:01.958391 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:43:01.958391 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:43:01.958391 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:43:01.958391 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:43:01.961842 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:43:01.961842 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:43:01.961842 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:43:01.961842 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume c333af7f-6171-4962-9180-9e563704adf0 is already attached to instances: fbe881d3-e162-43fb-a5d8-0c954d016ad3 May 19 13:43:01.961842 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:43:01.961842 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-a665f188-738f-49a7-802d-e2ca7c36e146 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Returning 400 to user: Invalid volume: volume c333af7f-6171-4962-9180-9e563704adf0 is already attached to instances: fbe881d3-e162-43fb-a5d8-0c954d016ad3 {{(pid=120471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:43:01.961842 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-a665f188-738f-49a7-802d-e2ca7c36e146 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "POST /compute/v2.1/servers/d4831f4e-33ee-459b-ac94-43ffe068e9fc/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100653 May 19 13:43:01.961842 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 475/935] 10.222.0.24 () {60 vars in 1322 bytes} [Thu May 19 13:43:01 2022] POST /compute/v2.1/servers/d4831f4e-33ee-459b-ac94-43ffe068e9fc/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 13:43:01.963672 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-7bb26f52-6c87-4328-b240-9db27c0a8109 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:43:01.963672 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-7bb26f52-6c87-4328-b240-9db27c0a8109 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: d4831f4e-33ee-459b-ac94-43ffe068e9fc] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:43:01.968770 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-7bb26f52-6c87-4328-b240-9db27c0a8109 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:01.969211 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-7bb26f52-6c87-4328-b240-9db27c0a8109 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:01.969995 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-7bb26f52-6c87-4328-b240-9db27c0a8109 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:01.970419 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-7bb26f52-6c87-4328-b240-9db27c0a8109 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:01.995789 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-7bb26f52-6c87-4328-b240-9db27c0a8109 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: d4831f4e-33ee-459b-ac94-43ffe068e9fc] Going to try to terminate instance {{(pid=120472) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 13:43:02.078055 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-7bb26f52-6c87-4328-b240-9db27c0a8109 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "DELETE /compute/v2.1/servers/d4831f4e-33ee-459b-ac94-43ffe068e9fc" status: 204 len: 0 microversion: 2.1 time: 0.119899 May 19 13:43:02.078669 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 461/936] 10.222.0.24 () {58 vars in 1238 bytes} [Thu May 19 13:43:01 2022] DELETE /compute/v2.1/servers/d4831f4e-33ee-459b-ac94-43ffe068e9fc => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 19 13:43:02.087642 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-2b1fb15b-d771-4edb-995a-9afec104053f tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:43:02.088263 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-2b1fb15b-d771-4edb-995a-9afec104053f tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: d4831f4e-33ee-459b-ac94-43ffe068e9fc] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:43:02.095766 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-2b1fb15b-d771-4edb-995a-9afec104053f tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:02.096338 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-2b1fb15b-d771-4edb-995a-9afec104053f tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:02.097096 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-2b1fb15b-d771-4edb-995a-9afec104053f tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:02.097559 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-2b1fb15b-d771-4edb-995a-9afec104053f tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:02.311862 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-2b1fb15b-d771-4edb-995a-9afec104053f tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa4a2a39deb4e7ba54032acec14e029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc560e8b75194743bbb46d903b481357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:43:02.319986 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-2b1fb15b-d771-4edb-995a-9afec104053f tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "GET /compute/v2.1/servers/d4831f4e-33ee-459b-ac94-43ffe068e9fc" status: 200 len: 1681 microversion: 2.1 time: 0.236619 May 19 13:43:02.320630 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 476/937] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:43:02 2022] GET /compute/v2.1/servers/d4831f4e-33ee-459b-ac94-43ffe068e9fc => generated 1681 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:43:02.452238 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-492973ee-8c0a-46db-bbea-c33aaf92e2a9 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:43:02.452839 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-492973ee-8c0a-46db-bbea-c33aaf92e2a9 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] [instance: 712420e9-2543-45fe-8b45-e46ca934a579] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:43:02.453757 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [req-26b919d3-96ae-4d18-82f1-6d778a5fb2eb req-5c059ee9-b76c-4b60-8fa6-422f164290e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "712420e9-2543-45fe-8b45-e46ca934a579", "tag": "d0ce9e8c-78f4-482c-b815-588341b22d40"}]} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:43:02.459013 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-492973ee-8c0a-46db-bbea-c33aaf92e2a9 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:02.459576 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-492973ee-8c0a-46db-bbea-c33aaf92e2a9 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:02.460348 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-492973ee-8c0a-46db-bbea-c33aaf92e2a9 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:02.460765 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-492973ee-8c0a-46db-bbea-c33aaf92e2a9 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:02.462241 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-26b919d3-96ae-4d18-82f1-6d778a5fb2eb req-5c059ee9-b76c-4b60-8fa6-422f164290e9 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:02.462670 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-26b919d3-96ae-4d18-82f1-6d778a5fb2eb req-5c059ee9-b76c-4b60-8fa6-422f164290e9 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:02.474253 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.compute.server_external_events [req-26b919d3-96ae-4d18-82f1-6d778a5fb2eb req-5c059ee9-b76c-4b60-8fa6-422f164290e9 service nova] Creating event network-changed:d0ce9e8c-78f4-482c-b815-588341b22d40 for instance 712420e9-2543-45fe-8b45-e46ca934a579 on hv-cinder-84112 May 19 13:43:02.479690 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [req-26b919d3-96ae-4d18-82f1-6d778a5fb2eb req-5c059ee9-b76c-4b60-8fa6-422f164290e9 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029736 May 19 13:43:02.480300 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 477/938] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:43:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 13:43:02.490449 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-492973ee-8c0a-46db-bbea-c33aaf92e2a9 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] [instance: 712420e9-2543-45fe-8b45-e46ca934a579] Going to try to terminate instance {{(pid=120472) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 13:43:02.573271 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-492973ee-8c0a-46db-bbea-c33aaf92e2a9 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] 10.222.0.24 "DELETE /compute/v2.1/servers/712420e9-2543-45fe-8b45-e46ca934a579" status: 204 len: 0 microversion: 2.1 time: 0.125177 May 19 13:43:02.574136 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 462/939] 10.222.0.24 () {58 vars in 1238 bytes} [Thu May 19 13:43:02 2022] DELETE /compute/v2.1/servers/712420e9-2543-45fe-8b45-e46ca934a579 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 13:43:02.582931 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-b61d1315-9fd4-4ec6-8aa8-ac36db80dd90 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:43:02.583639 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-b61d1315-9fd4-4ec6-8aa8-ac36db80dd90 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] [instance: 712420e9-2543-45fe-8b45-e46ca934a579] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:43:02.590770 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-b61d1315-9fd4-4ec6-8aa8-ac36db80dd90 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:02.591230 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-b61d1315-9fd4-4ec6-8aa8-ac36db80dd90 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:02.592004 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-b61d1315-9fd4-4ec6-8aa8-ac36db80dd90 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:02.592443 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-b61d1315-9fd4-4ec6-8aa8-ac36db80dd90 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:02.736080 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-b61d1315-9fd4-4ec6-8aa8-ac36db80dd90 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0a4b41707d444581ee0aa2296ac0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ad7b921dbc4a8d9e9be0d50385deee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:43:02.743878 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-b61d1315-9fd4-4ec6-8aa8-ac36db80dd90 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] 10.222.0.24 "GET /compute/v2.1/servers/712420e9-2543-45fe-8b45-e46ca934a579" status: 200 len: 1576 microversion: 2.1 time: 0.165222 May 19 13:43:02.744399 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 478/940] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:43:02 2022] GET /compute/v2.1/servers/712420e9-2543-45fe-8b45-e46ca934a579 => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:43:03.338946 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-526f8009-f7e8-4e86-aeb9-ae55c3d1c6c7 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:43:03.340044 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-526f8009-f7e8-4e86-aeb9-ae55c3d1c6c7 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: d4831f4e-33ee-459b-ac94-43ffe068e9fc] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:43:03.347360 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-526f8009-f7e8-4e86-aeb9-ae55c3d1c6c7 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:03.347802 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-526f8009-f7e8-4e86-aeb9-ae55c3d1c6c7 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:03.348557 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-526f8009-f7e8-4e86-aeb9-ae55c3d1c6c7 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:03.348975 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-526f8009-f7e8-4e86-aeb9-ae55c3d1c6c7 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:03.488219 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-526f8009-f7e8-4e86-aeb9-ae55c3d1c6c7 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa4a2a39deb4e7ba54032acec14e029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc560e8b75194743bbb46d903b481357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:43:03.496003 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-526f8009-f7e8-4e86-aeb9-ae55c3d1c6c7 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "GET /compute/v2.1/servers/d4831f4e-33ee-459b-ac94-43ffe068e9fc" status: 200 len: 1681 microversion: 2.1 time: 0.161379 May 19 13:43:03.496554 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 463/941] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:43:03 2022] GET /compute/v2.1/servers/d4831f4e-33ee-459b-ac94-43ffe068e9fc => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:43:03.762583 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-bfc5a33a-227b-4b16-8530-ebe5a159b047 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:43:03.763932 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-bfc5a33a-227b-4b16-8530-ebe5a159b047 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] [instance: 712420e9-2543-45fe-8b45-e46ca934a579] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:43:03.772209 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-bfc5a33a-227b-4b16-8530-ebe5a159b047 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:03.772740 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-bfc5a33a-227b-4b16-8530-ebe5a159b047 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:03.773698 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-bfc5a33a-227b-4b16-8530-ebe5a159b047 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:03.774213 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-bfc5a33a-227b-4b16-8530-ebe5a159b047 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:03.910875 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-bfc5a33a-227b-4b16-8530-ebe5a159b047 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0a4b41707d444581ee0aa2296ac0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ad7b921dbc4a8d9e9be0d50385deee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:43:03.921926 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-bfc5a33a-227b-4b16-8530-ebe5a159b047 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] 10.222.0.24 "GET /compute/v2.1/servers/712420e9-2543-45fe-8b45-e46ca934a579" status: 200 len: 1576 microversion: 2.1 time: 0.164034 May 19 13:43:03.922504 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 479/942] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:43:03 2022] GET /compute/v2.1/servers/712420e9-2543-45fe-8b45-e46ca934a579 => generated 1576 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:43:04.518035 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-b658232c-f323-45c7-a89f-c9ff7eae23a3 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:43:04.519135 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-b658232c-f323-45c7-a89f-c9ff7eae23a3 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: d4831f4e-33ee-459b-ac94-43ffe068e9fc] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:43:04.530062 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-b658232c-f323-45c7-a89f-c9ff7eae23a3 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:04.530506 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-b658232c-f323-45c7-a89f-c9ff7eae23a3 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:04.531322 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-b658232c-f323-45c7-a89f-c9ff7eae23a3 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:04.531751 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-b658232c-f323-45c7-a89f-c9ff7eae23a3 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:04.669893 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-b658232c-f323-45c7-a89f-c9ff7eae23a3 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa4a2a39deb4e7ba54032acec14e029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc560e8b75194743bbb46d903b481357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:43:04.677863 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-b658232c-f323-45c7-a89f-c9ff7eae23a3 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "GET /compute/v2.1/servers/d4831f4e-33ee-459b-ac94-43ffe068e9fc" status: 200 len: 1681 microversion: 2.1 time: 0.167418 May 19 13:43:04.678403 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 464/943] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:43:04 2022] GET /compute/v2.1/servers/d4831f4e-33ee-459b-ac94-43ffe068e9fc => generated 1681 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:43:04.940461 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-b9408915-3849-4ce0-b260-dbe5eef4589f tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:43:04.941066 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-b9408915-3849-4ce0-b260-dbe5eef4589f tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] [instance: 712420e9-2543-45fe-8b45-e46ca934a579] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:43:04.948029 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-b9408915-3849-4ce0-b260-dbe5eef4589f tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:04.948483 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-b9408915-3849-4ce0-b260-dbe5eef4589f tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:04.949337 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-b9408915-3849-4ce0-b260-dbe5eef4589f tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:04.949814 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-b9408915-3849-4ce0-b260-dbe5eef4589f tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:05.086721 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-b9408915-3849-4ce0-b260-dbe5eef4589f tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0a4b41707d444581ee0aa2296ac0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ad7b921dbc4a8d9e9be0d50385deee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:43:05.095438 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-b9408915-3849-4ce0-b260-dbe5eef4589f tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] 10.222.0.24 "GET /compute/v2.1/servers/712420e9-2543-45fe-8b45-e46ca934a579" status: 200 len: 1576 microversion: 2.1 time: 0.158993 May 19 13:43:05.096005 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 480/944] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:43:04 2022] GET /compute/v2.1/servers/712420e9-2543-45fe-8b45-e46ca934a579 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:43:05.702948 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-d0066e7a-8c07-41ba-aa54-e182bcb282ee tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:43:05.703579 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-d0066e7a-8c07-41ba-aa54-e182bcb282ee tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: d4831f4e-33ee-459b-ac94-43ffe068e9fc] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:43:05.710398 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-d0066e7a-8c07-41ba-aa54-e182bcb282ee tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:05.710832 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-d0066e7a-8c07-41ba-aa54-e182bcb282ee tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:05.711601 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-d0066e7a-8c07-41ba-aa54-e182bcb282ee tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:05.712032 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-d0066e7a-8c07-41ba-aa54-e182bcb282ee tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:06.036736 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-d0066e7a-8c07-41ba-aa54-e182bcb282ee tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa4a2a39deb4e7ba54032acec14e029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc560e8b75194743bbb46d903b481357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:43:06.045790 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-d0066e7a-8c07-41ba-aa54-e182bcb282ee tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "GET /compute/v2.1/servers/d4831f4e-33ee-459b-ac94-43ffe068e9fc" status: 200 len: 1681 microversion: 2.1 time: 0.346817 May 19 13:43:06.046368 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 465/945] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:43:05 2022] GET /compute/v2.1/servers/d4831f4e-33ee-459b-ac94-43ffe068e9fc => generated 1681 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:43:06.116285 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-63990829-022d-49f8-97be-9289b4fa6172 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:43:06.116900 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-63990829-022d-49f8-97be-9289b4fa6172 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] [instance: 712420e9-2543-45fe-8b45-e46ca934a579] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:43:06.124437 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-63990829-022d-49f8-97be-9289b4fa6172 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:06.124897 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-63990829-022d-49f8-97be-9289b4fa6172 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:06.125718 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-63990829-022d-49f8-97be-9289b4fa6172 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:06.126154 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-63990829-022d-49f8-97be-9289b4fa6172 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:06.192132 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-63990829-022d-49f8-97be-9289b4fa6172 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0a4b41707d444581ee0aa2296ac0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ad7b921dbc4a8d9e9be0d50385deee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:43:06.200029 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-63990829-022d-49f8-97be-9289b4fa6172 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] 10.222.0.24 "GET /compute/v2.1/servers/712420e9-2543-45fe-8b45-e46ca934a579" status: 200 len: 1390 microversion: 2.1 time: 0.090911 May 19 13:43:06.201051 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 481/946] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:43:06 2022] GET /compute/v2.1/servers/712420e9-2543-45fe-8b45-e46ca934a579 => generated 1390 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:43:06.277111 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [req-a1586189-26e1-41ce-a624-e9080336e548 req-148dd068-e206-4aef-b976-cb0d5f64fe1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "712420e9-2543-45fe-8b45-e46ca934a579", "name": "network-vif-deleted", "tag": "d0ce9e8c-78f4-482c-b815-588341b22d40"}]} {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:43:06.289572 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [req-a1586189-26e1-41ce-a624-e9080336e548 req-148dd068-e206-4aef-b976-cb0d5f64fe1c service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:06.290262 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [req-a1586189-26e1-41ce-a624-e9080336e548 req-148dd068-e206-4aef-b976-cb0d5f64fe1c service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:06.304521 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.compute.server_external_events [req-a1586189-26e1-41ce-a624-e9080336e548 req-148dd068-e206-4aef-b976-cb0d5f64fe1c service nova] Creating event network-vif-deleted:d0ce9e8c-78f4-482c-b815-588341b22d40 for instance 712420e9-2543-45fe-8b45-e46ca934a579 on hv-cinder-84112 May 19 13:43:06.309366 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [req-a1586189-26e1-41ce-a624-e9080336e548 req-148dd068-e206-4aef-b976-cb0d5f64fe1c service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102917 May 19 13:43:06.310211 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 466/947] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:43:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:43:07.064221 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-e9318078-71dd-41a0-84aa-8d1f63847995 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:43:07.064942 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-e9318078-71dd-41a0-84aa-8d1f63847995 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: d4831f4e-33ee-459b-ac94-43ffe068e9fc] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:43:07.071583 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-e9318078-71dd-41a0-84aa-8d1f63847995 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:07.072113 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-e9318078-71dd-41a0-84aa-8d1f63847995 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:07.072960 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-e9318078-71dd-41a0-84aa-8d1f63847995 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:07.073399 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-e9318078-71dd-41a0-84aa-8d1f63847995 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:07.106346 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-e9318078-71dd-41a0-84aa-8d1f63847995 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:07.107208 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-e9318078-71dd-41a0-84aa-8d1f63847995 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:07.107868 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.objects.instance [None req-e9318078-71dd-41a0-84aa-8d1f63847995 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lazy-loading 'fault' on Instance uuid d4831f4e-33ee-459b-ac94-43ffe068e9fc {{(pid=120471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 13:43:07.148012 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-e9318078-71dd-41a0-84aa-8d1f63847995 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa4a2a39deb4e7ba54032acec14e029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc560e8b75194743bbb46d903b481357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:43:07.156390 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-e9318078-71dd-41a0-84aa-8d1f63847995 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "GET /compute/v2.1/servers/d4831f4e-33ee-459b-ac94-43ffe068e9fc" status: 200 len: 1332 microversion: 2.1 time: 0.096740 May 19 13:43:07.157162 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 482/948] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:43:07 2022] GET /compute/v2.1/servers/d4831f4e-33ee-459b-ac94-43ffe068e9fc => generated 1332 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:43:07.218168 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-4d2b873b-f61e-4372-94f9-def747a0243e tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:43:07.219016 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-4d2b873b-f61e-4372-94f9-def747a0243e tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] [instance: 712420e9-2543-45fe-8b45-e46ca934a579] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:43:07.226295 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-4d2b873b-f61e-4372-94f9-def747a0243e tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:07.227046 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-4d2b873b-f61e-4372-94f9-def747a0243e tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:07.228004 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-4d2b873b-f61e-4372-94f9-def747a0243e tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:07.228425 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-4d2b873b-f61e-4372-94f9-def747a0243e tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:07.266570 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-4d2b873b-f61e-4372-94f9-def747a0243e tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:07.267508 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-4d2b873b-f61e-4372-94f9-def747a0243e tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:07.267508 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.objects.instance [None req-4d2b873b-f61e-4372-94f9-def747a0243e tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lazy-loading 'fault' on Instance uuid 712420e9-2543-45fe-8b45-e46ca934a579 {{(pid=120472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 13:43:07.313692 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-4d2b873b-f61e-4372-94f9-def747a0243e tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0a4b41707d444581ee0aa2296ac0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ad7b921dbc4a8d9e9be0d50385deee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:43:07.321378 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-4d2b873b-f61e-4372-94f9-def747a0243e tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] 10.222.0.24 "GET /compute/v2.1/servers/712420e9-2543-45fe-8b45-e46ca934a579" status: 200 len: 1230 microversion: 2.1 time: 0.107562 May 19 13:43:07.322092 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 467/949] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:43:07 2022] GET /compute/v2.1/servers/712420e9-2543-45fe-8b45-e46ca934a579 => generated 1230 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:43:08.179086 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-8298d014-1ef8-4638-93a2-dc740f16e3fa tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:43:08.180628 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-8298d014-1ef8-4638-93a2-dc740f16e3fa tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: d4831f4e-33ee-459b-ac94-43ffe068e9fc] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:43:08.191100 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-8298d014-1ef8-4638-93a2-dc740f16e3fa tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:08.191831 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-8298d014-1ef8-4638-93a2-dc740f16e3fa tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:08.192945 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-8298d014-1ef8-4638-93a2-dc740f16e3fa tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:08.193692 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-8298d014-1ef8-4638-93a2-dc740f16e3fa tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:08.209571 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.wsgi [None req-8298d014-1ef8-4638-93a2-dc740f16e3fa tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] HTTP exception thrown: Instance d4831f4e-33ee-459b-ac94-43ffe068e9fc could not be found. May 19 13:43:08.211263 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-8298d014-1ef8-4638-93a2-dc740f16e3fa tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Request method failure captured: May 19 13:43:08.211263 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: request: GET /compute/v2.1/servers/d4831f4e-33ee-459b-ac94-43ffe068e9fc HTTP/1.1 May 19 13:43:08.211263 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Accept: application/json May 19 13:43:08.211263 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Accept-Encoding: identity May 19 13:43:08.211263 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Connection: close May 19 13:43:08.211263 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Content-Length: 0 May 19 13:43:08.211263 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Content-Type: application/json May 19 13:43:08.211263 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Host: 10.222.0.24 May 19 13:43:08.211263 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Openstack-System-Scope: None May 19 13:43:08.211263 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: User-Agent: python-urllib3/1.26.9 May 19 13:43:08.211263 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Auth-Token: gAAAAABihkj6liBLvukkw2qtst-UG_cKJZiNcCgt6W_kQDYluV0QF-s3L61GELG86yuBU_XP0oEocHGYFB77RCnoJWx_PSe5oCa2SU8RfG2VbbO9_x7MK34OtxqKFCLvWQmkpMAhKbbulm_ByBEFHwsuhM1s6duzmOYoRlcr_Dq0_GCOhJ038Nk May 19 13:43:08.211263 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Domain-Id: None May 19 13:43:08.211263 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Domain-Name: None May 19 13:43:08.211263 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Identity-Status: Confirmed May 19 13:43:08.211263 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Is-Admin-Project: True May 19 13:43:08.211263 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Domain-Id: default May 19 13:43:08.211263 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Domain-Name: Default May 19 13:43:08.211263 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Id: bc560e8b75194743bbb46d903b481357 May 19 13:43:08.211263 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Name: tempest-AttachVolumeNegativeTest-35839424 May 19 13:43:08.211263 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Role: reader,member May 19 13:43:08.211263 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Roles: reader,member May 19 13:43:08.213030 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/bc560e8b75194743bbb46d903b481357"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/bc560e8b75194743bbb46d903b481357"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_bc560e8b75194743bbb46d903b481357", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/bc560e8b75194743bbb46d903b481357"}]}] May 19 13:43:08.213030 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Tenant: tempest-AttachVolumeNegativeTest-35839424 May 19 13:43:08.213030 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Tenant-Id: bc560e8b75194743bbb46d903b481357 May 19 13:43:08.213030 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-35839424 May 19 13:43:08.213030 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User: tempest-AttachVolumeNegativeTest-35839424-project May 19 13:43:08.213030 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Domain-Id: default May 19 13:43:08.213030 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Domain-Name: Default May 19 13:43:08.213030 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Id: daa4a2a39deb4e7ba54032acec14e029 May 19 13:43:08.213030 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Name: tempest-AttachVolumeNegativeTest-35839424-project May 19 13:43:08.213030 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: method: > May 19 13:43:08.213030 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: exception: Instance d4831f4e-33ee-459b-ac94-43ffe068e9fc could not be found. May 19 13:43:08.213030 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: action_args: {'id': 'd4831f4e-33ee-459b-ac94-43ffe068e9fc'} May 19 13:43:08.214050 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:43:08.214050 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:43:08.214050 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 13:43:08.214050 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 13:43:08.214050 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 13:43:08.214050 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 13:43:08.214050 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 13:43:08.214050 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 13:43:08.214050 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 13:43:08.214050 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 13:43:08.214050 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4831f4e-33ee-459b-ac94-43ffe068e9fc could not be found. May 19 13:43:08.214050 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:43:08.214050 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:43:08.214050 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:43:08.214050 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:43:08.214050 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:43:08.214050 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:43:08.214050 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:43:08.214050 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:43:08.214050 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:43:08.215646 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:43:08.215646 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 13:43:08.215646 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 13:43:08.215646 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 13:43:08.215646 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 13:43:08.215646 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 13:43:08.215646 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 13:43:08.215646 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4831f4e-33ee-459b-ac94-43ffe068e9fc could not be found. May 19 13:43:08.215646 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:43:08.215646 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:43:08.215646 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:43:08.215646 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:43:08.215646 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:43:08.215646 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:43:08.215646 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:43:08.215646 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:43:08.215646 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4831f4e-33ee-459b-ac94-43ffe068e9fc could not be found. May 19 13:43:08.215646 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:43:08.217044 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-8298d014-1ef8-4638-93a2-dc740f16e3fa tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Returning 404 to user: Instance d4831f4e-33ee-459b-ac94-43ffe068e9fc could not be found. {{(pid=120471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:43:08.217044 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-8298d014-1ef8-4638-93a2-dc740f16e3fa tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "GET /compute/v2.1/servers/d4831f4e-33ee-459b-ac94-43ffe068e9fc" status: 404 len: 111 microversion: 2.1 time: 0.040950 May 19 13:43:08.217044 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 483/950] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:43:08 2022] GET /compute/v2.1/servers/d4831f4e-33ee-459b-ac94-43ffe068e9fc => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 13:43:08.222223 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-e46d0a04-8ceb-4d4d-a586-b01a496cd937 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Calling method '.version_select at 0x7f7c2a4e5e50>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:43:08.244216 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-e46d0a04-8ceb-4d4d-a586-b01a496cd937 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1808020144" status: 202 len: 0 microversion: 2.1 time: 0.025802 May 19 13:43:08.244899 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 468/951] 10.222.0.24 () {58 vars in 1220 bytes} [Thu May 19 13:43:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1808020144 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 13:43:08.328563 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [req-02f34f20-3e02-4d3e-a987-56470efb7e71 req-6d155e57-edb6-46ab-9c66-61133fb4636c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4831f4e-33ee-459b-ac94-43ffe068e9fc", "name": "network-vif-deleted", "tag": "cfdcc325-e513-44bd-868d-d15c7db79c65"}]} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:43:08.337448 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-02f34f20-3e02-4d3e-a987-56470efb7e71 req-6d155e57-edb6-46ab-9c66-61133fb4636c service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:08.337909 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-02f34f20-3e02-4d3e-a987-56470efb7e71 req-6d155e57-edb6-46ab-9c66-61133fb4636c service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:08.338942 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-008ddd8a-d57e-4c48-b914-c16c5208af78 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:43:08.339557 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-008ddd8a-d57e-4c48-b914-c16c5208af78 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] [instance: 712420e9-2543-45fe-8b45-e46ca934a579] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:43:08.347395 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-008ddd8a-d57e-4c48-b914-c16c5208af78 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:08.348091 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-008ddd8a-d57e-4c48-b914-c16c5208af78 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:08.349116 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-008ddd8a-d57e-4c48-b914-c16c5208af78 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:08.349739 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-008ddd8a-d57e-4c48-b914-c16c5208af78 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:08.362315 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.compute.server_external_events [req-02f34f20-3e02-4d3e-a987-56470efb7e71 req-6d155e57-edb6-46ab-9c66-61133fb4636c service nova] Creating event network-vif-deleted:cfdcc325-e513-44bd-868d-d15c7db79c65 for instance d4831f4e-33ee-459b-ac94-43ffe068e9fc on hv-cinder-84112 May 19 13:43:08.363956 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.wsgi [None req-008ddd8a-d57e-4c48-b914-c16c5208af78 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] HTTP exception thrown: Instance 712420e9-2543-45fe-8b45-e46ca934a579 could not be found. May 19 13:43:08.366520 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-008ddd8a-d57e-4c48-b914-c16c5208af78 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Request method failure captured: May 19 13:43:08.366520 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: request: GET /compute/v2.1/servers/712420e9-2543-45fe-8b45-e46ca934a579 HTTP/1.1 May 19 13:43:08.366520 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Accept: application/json May 19 13:43:08.366520 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Accept-Encoding: identity May 19 13:43:08.366520 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Connection: close May 19 13:43:08.366520 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Content-Length: 0 May 19 13:43:08.366520 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Content-Type: application/json May 19 13:43:08.366520 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Host: 10.222.0.24 May 19 13:43:08.366520 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Openstack-System-Scope: None May 19 13:43:08.366520 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: User-Agent: python-urllib3/1.26.9 May 19 13:43:08.366520 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Auth-Token: gAAAAABihkfZZi3CO4kgMRQyXdYId70aYnRUeD_PBCoZE9_U-eSRdPDJ8U-K8FIgr4iKsCo_31Ll0TF-QRYIfsMapwxYbX4ntNVtGmD2GqJq7AavkFVumf5rk50QPpfFewjlRyH5ReYCECCj_Fybs53mzU-L1x3JDP2S0BBbSe44_2Eh-84z8Aw May 19 13:43:08.366520 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Domain-Id: None May 19 13:43:08.366520 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Domain-Name: None May 19 13:43:08.366520 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Identity-Status: Confirmed May 19 13:43:08.366520 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Is-Admin-Project: True May 19 13:43:08.366520 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Domain-Id: default May 19 13:43:08.366520 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Domain-Name: Default May 19 13:43:08.366520 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Id: 98ad7b921dbc4a8d9e9be0d50385deee May 19 13:43:08.366520 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Name: tempest-TestVolumeBootPattern-1301025888 May 19 13:43:08.366520 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Role: reader,member May 19 13:43:08.366520 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Roles: reader,member May 19 13:43:08.368269 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/98ad7b921dbc4a8d9e9be0d50385deee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/98ad7b921dbc4a8d9e9be0d50385deee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_98ad7b921dbc4a8d9e9be0d50385deee", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/98ad7b921dbc4a8d9e9be0d50385deee"}]}] May 19 13:43:08.368269 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant: tempest-TestVolumeBootPattern-1301025888 May 19 13:43:08.368269 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant-Id: 98ad7b921dbc4a8d9e9be0d50385deee May 19 13:43:08.368269 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant-Name: tempest-TestVolumeBootPattern-1301025888 May 19 13:43:08.368269 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User: tempest-TestVolumeBootPattern-1301025888-project May 19 13:43:08.368269 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Domain-Id: default May 19 13:43:08.368269 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Domain-Name: Default May 19 13:43:08.368269 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Id: aa0a4b41707d444581ee0aa2296ac0ba May 19 13:43:08.368269 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Name: tempest-TestVolumeBootPattern-1301025888-project May 19 13:43:08.368269 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: method: > May 19 13:43:08.368269 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: exception: Instance 712420e9-2543-45fe-8b45-e46ca934a579 could not be found. May 19 13:43:08.368269 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: action_args: {'id': '712420e9-2543-45fe-8b45-e46ca934a579'} May 19 13:43:08.369253 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:43:08.369253 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:43:08.369253 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 13:43:08.369253 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 13:43:08.369253 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 13:43:08.369253 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 13:43:08.369253 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 13:43:08.369253 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 13:43:08.369253 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 13:43:08.369253 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 13:43:08.369253 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 712420e9-2543-45fe-8b45-e46ca934a579 could not be found. May 19 13:43:08.369253 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:43:08.369253 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:43:08.369253 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:43:08.369253 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:43:08.369253 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:43:08.369253 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:43:08.369253 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:43:08.369253 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:43:08.369253 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:43:08.370815 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:43:08.370815 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 13:43:08.370815 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 13:43:08.370815 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 13:43:08.370815 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 13:43:08.370815 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 13:43:08.370815 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 13:43:08.370815 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 712420e9-2543-45fe-8b45-e46ca934a579 could not be found. May 19 13:43:08.370815 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:43:08.370815 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:43:08.370815 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:43:08.370815 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:43:08.370815 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:43:08.370815 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:43:08.370815 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:43:08.370815 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:43:08.370815 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 712420e9-2543-45fe-8b45-e46ca934a579 could not be found. May 19 13:43:08.370815 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:43:08.372192 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-008ddd8a-d57e-4c48-b914-c16c5208af78 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Returning 404 to user: Instance 712420e9-2543-45fe-8b45-e46ca934a579 could not be found. {{(pid=120472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:43:08.372192 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-008ddd8a-d57e-4c48-b914-c16c5208af78 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] 10.222.0.24 "GET /compute/v2.1/servers/712420e9-2543-45fe-8b45-e46ca934a579" status: 404 len: 111 microversion: 2.1 time: 0.033587 May 19 13:43:08.372192 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 469/952] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:43:08 2022] GET /compute/v2.1/servers/712420e9-2543-45fe-8b45-e46ca934a579 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 13:43:08.372731 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [req-02f34f20-3e02-4d3e-a987-56470efb7e71 req-6d155e57-edb6-46ab-9c66-61133fb4636c service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045519 May 19 13:43:08.374050 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 484/953] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:43:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:43:08.962611 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-a58ba818-cc45-4688-b32f-aaaf57a8e37c tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:43:08.963175 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-a58ba818-cc45-4688-b32f-aaaf57a8e37c tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: fbe881d3-e162-43fb-a5d8-0c954d016ad3] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:43:08.970664 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-a58ba818-cc45-4688-b32f-aaaf57a8e37c tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:08.971110 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-a58ba818-cc45-4688-b32f-aaaf57a8e37c tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:08.971872 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-a58ba818-cc45-4688-b32f-aaaf57a8e37c tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:08.972307 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-a58ba818-cc45-4688-b32f-aaaf57a8e37c tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:09.074130 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.objects.instance [None req-a58ba818-cc45-4688-b32f-aaaf57a8e37c tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lazy-loading 'services' on Instance uuid fbe881d3-e162-43fb-a5d8-0c954d016ad3 {{(pid=120472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 13:43:09.153957 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-a58ba818-cc45-4688-b32f-aaaf57a8e37c tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "DELETE /compute/v2.1/servers/fbe881d3-e162-43fb-a5d8-0c954d016ad3/os-volume_attachments/c333af7f-6171-4962-9180-9e563704adf0" status: 202 len: 0 microversion: 2.1 time: 0.195323 May 19 13:43:09.154541 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 470/954] 10.222.0.24 () {58 vars in 1415 bytes} [Thu May 19 13:43:08 2022] DELETE /compute/v2.1/servers/fbe881d3-e162-43fb-a5d8-0c954d016ad3/os-volume_attachments/c333af7f-6171-4962-9180-9e563704adf0 => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 13:43:09.164351 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-78f2c9ab-f01d-4a9a-a1ee-4b6b8f788d9e tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:43:09.165530 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-78f2c9ab-f01d-4a9a-a1ee-4b6b8f788d9e tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: fbe881d3-e162-43fb-a5d8-0c954d016ad3] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:43:09.173531 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-78f2c9ab-f01d-4a9a-a1ee-4b6b8f788d9e tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:09.174158 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-78f2c9ab-f01d-4a9a-a1ee-4b6b8f788d9e tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:09.175050 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-78f2c9ab-f01d-4a9a-a1ee-4b6b8f788d9e tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:09.175523 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-78f2c9ab-f01d-4a9a-a1ee-4b6b8f788d9e tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:09.209121 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-78f2c9ab-f01d-4a9a-a1ee-4b6b8f788d9e tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "GET /compute/v2.1/servers/fbe881d3-e162-43fb-a5d8-0c954d016ad3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049258 May 19 13:43:09.209866 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 485/955] 10.222.0.24 () {58 vars in 1301 bytes} [Thu May 19 13:43:09 2022] GET /compute/v2.1/servers/fbe881d3-e162-43fb-a5d8-0c954d016ad3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:43:10.223399 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-20df3f0c-bc36-4f3a-a09c-330160597a8b tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:43:10.224463 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-20df3f0c-bc36-4f3a-a09c-330160597a8b tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: fbe881d3-e162-43fb-a5d8-0c954d016ad3] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:43:10.231245 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-20df3f0c-bc36-4f3a-a09c-330160597a8b tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:10.231681 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-20df3f0c-bc36-4f3a-a09c-330160597a8b tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:10.232540 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-20df3f0c-bc36-4f3a-a09c-330160597a8b tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:10.232976 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-20df3f0c-bc36-4f3a-a09c-330160597a8b tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:10.263822 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-20df3f0c-bc36-4f3a-a09c-330160597a8b tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "GET /compute/v2.1/servers/fbe881d3-e162-43fb-a5d8-0c954d016ad3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045562 May 19 13:43:10.264404 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 471/956] 10.222.0.24 () {58 vars in 1301 bytes} [Thu May 19 13:43:10 2022] GET /compute/v2.1/servers/fbe881d3-e162-43fb-a5d8-0c954d016ad3/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 13:43:10.324395 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-b3bf2aa9-c844-411a-b461-de00a946a121 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:43:10.324966 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-b3bf2aa9-c844-411a-b461-de00a946a121 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: fbe881d3-e162-43fb-a5d8-0c954d016ad3] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:43:10.331779 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-b3bf2aa9-c844-411a-b461-de00a946a121 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:10.332164 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-b3bf2aa9-c844-411a-b461-de00a946a121 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:10.332948 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-b3bf2aa9-c844-411a-b461-de00a946a121 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:10.333436 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-b3bf2aa9-c844-411a-b461-de00a946a121 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:10.359920 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-b3bf2aa9-c844-411a-b461-de00a946a121 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: fbe881d3-e162-43fb-a5d8-0c954d016ad3] Going to try to terminate instance {{(pid=120471) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 13:43:10.448027 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-b3bf2aa9-c844-411a-b461-de00a946a121 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "DELETE /compute/v2.1/servers/fbe881d3-e162-43fb-a5d8-0c954d016ad3" status: 204 len: 0 microversion: 2.1 time: 0.127333 May 19 13:43:10.448606 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 486/957] 10.222.0.24 () {58 vars in 1238 bytes} [Thu May 19 13:43:10 2022] DELETE /compute/v2.1/servers/fbe881d3-e162-43fb-a5d8-0c954d016ad3 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 13:43:10.457248 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-3bf58bb5-bb5f-432a-81e4-5a873632099d tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:43:10.457902 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-3bf58bb5-bb5f-432a-81e4-5a873632099d tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: fbe881d3-e162-43fb-a5d8-0c954d016ad3] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:43:10.464118 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-3bf58bb5-bb5f-432a-81e4-5a873632099d tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:10.464556 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-3bf58bb5-bb5f-432a-81e4-5a873632099d tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:10.465304 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-3bf58bb5-bb5f-432a-81e4-5a873632099d tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:10.465758 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-3bf58bb5-bb5f-432a-81e4-5a873632099d tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:10.622921 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-3bf58bb5-bb5f-432a-81e4-5a873632099d tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa4a2a39deb4e7ba54032acec14e029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc560e8b75194743bbb46d903b481357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:43:10.630956 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-3bf58bb5-bb5f-432a-81e4-5a873632099d tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "GET /compute/v2.1/servers/fbe881d3-e162-43fb-a5d8-0c954d016ad3" status: 200 len: 1680 microversion: 2.1 time: 0.177587 May 19 13:43:10.631756 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 472/958] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:43:10 2022] GET /compute/v2.1/servers/fbe881d3-e162-43fb-a5d8-0c954d016ad3 => generated 1680 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:43:11.648844 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-0b722709-6ea1-4204-ac01-33db9f82b085 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:43:11.649584 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-0b722709-6ea1-4204-ac01-33db9f82b085 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: fbe881d3-e162-43fb-a5d8-0c954d016ad3] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:43:11.656836 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-0b722709-6ea1-4204-ac01-33db9f82b085 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:11.657256 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-0b722709-6ea1-4204-ac01-33db9f82b085 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:11.658283 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-0b722709-6ea1-4204-ac01-33db9f82b085 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:11.658719 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-0b722709-6ea1-4204-ac01-33db9f82b085 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:11.788243 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-8698f422-9408-4761-81e7-73d55c4a09a5 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:43:11.788780 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-8698f422-9408-4761-81e7-73d55c4a09a5 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] [instance: e04724e3-bd2a-49a5-bad8-c9d186bc7211] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:43:11.796615 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-8698f422-9408-4761-81e7-73d55c4a09a5 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:11.797131 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-8698f422-9408-4761-81e7-73d55c4a09a5 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:11.797928 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-8698f422-9408-4761-81e7-73d55c4a09a5 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:11.798353 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-8698f422-9408-4761-81e7-73d55c4a09a5 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:11.825987 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-8698f422-9408-4761-81e7-73d55c4a09a5 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] [instance: e04724e3-bd2a-49a5-bad8-c9d186bc7211] Going to try to terminate instance {{(pid=120472) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 13:43:11.839101 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-0b722709-6ea1-4204-ac01-33db9f82b085 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa4a2a39deb4e7ba54032acec14e029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc560e8b75194743bbb46d903b481357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:43:11.851342 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-0b722709-6ea1-4204-ac01-33db9f82b085 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "GET /compute/v2.1/servers/fbe881d3-e162-43fb-a5d8-0c954d016ad3" status: 200 len: 1680 microversion: 2.1 time: 0.206743 May 19 13:43:11.852191 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 487/959] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:43:11 2022] GET /compute/v2.1/servers/fbe881d3-e162-43fb-a5d8-0c954d016ad3 => generated 1680 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:43:11.868298 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [req-f5b2af2e-9cd6-4a85-91a5-287839aa52d1 req-40c4efb9-a8d3-405d-8f6c-ffbe8ca816f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e04724e3-bd2a-49a5-bad8-c9d186bc7211", "tag": "c0ab3804-fc2a-4ea2-b784-19b69d342b58"}]} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:43:11.874809 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:43:11.878871 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-f5b2af2e-9cd6-4a85-91a5-287839aa52d1 req-40c4efb9-a8d3-405d-8f6c-ffbe8ca816f7 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:11.879452 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-f5b2af2e-9cd6-4a85-91a5-287839aa52d1 req-40c4efb9-a8d3-405d-8f6c-ffbe8ca816f7 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:11.894014 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.compute.server_external_events [req-f5b2af2e-9cd6-4a85-91a5-287839aa52d1 req-40c4efb9-a8d3-405d-8f6c-ffbe8ca816f7 service nova] Creating event network-changed:c0ab3804-fc2a-4ea2-b784-19b69d342b58 for instance e04724e3-bd2a-49a5-bad8-c9d186bc7211 on hv-cinder-84112 May 19 13:43:11.899494 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [req-f5b2af2e-9cd6-4a85-91a5-287839aa52d1 req-40c4efb9-a8d3-405d-8f6c-ffbe8ca816f7 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034848 May 19 13:43:11.900949 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 488/960] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:43:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:43:11.933229 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-8698f422-9408-4761-81e7-73d55c4a09a5 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] 10.222.0.24 "DELETE /compute/v2.1/servers/e04724e3-bd2a-49a5-bad8-c9d186bc7211" status: 204 len: 0 microversion: 2.1 time: 0.149679 May 19 13:43:11.933861 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 473/961] 10.222.0.24 () {58 vars in 1238 bytes} [Thu May 19 13:43:11 2022] DELETE /compute/v2.1/servers/e04724e3-bd2a-49a5-bad8-c9d186bc7211 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 13:43:11.943242 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-6ebe3390-d550-4b6d-926c-a64ca2361f25 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:43:11.943946 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-6ebe3390-d550-4b6d-926c-a64ca2361f25 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] [instance: e04724e3-bd2a-49a5-bad8-c9d186bc7211] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:43:11.950435 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-6ebe3390-d550-4b6d-926c-a64ca2361f25 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:11.950864 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-6ebe3390-d550-4b6d-926c-a64ca2361f25 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:11.951826 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-6ebe3390-d550-4b6d-926c-a64ca2361f25 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:11.952264 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-6ebe3390-d550-4b6d-926c-a64ca2361f25 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:12.096359 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-6ebe3390-d550-4b6d-926c-a64ca2361f25 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0a4b41707d444581ee0aa2296ac0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ad7b921dbc4a8d9e9be0d50385deee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:43:12.104548 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-6ebe3390-d550-4b6d-926c-a64ca2361f25 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] 10.222.0.24 "GET /compute/v2.1/servers/e04724e3-bd2a-49a5-bad8-c9d186bc7211" status: 200 len: 1576 microversion: 2.1 time: 0.165838 May 19 13:43:12.105099 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 489/962] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:43:11 2022] GET /compute/v2.1/servers/e04724e3-bd2a-49a5-bad8-c9d186bc7211 => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:43:12.873216 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-20bd1bb6-2327-46a8-b2a3-37bd6909e547 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:43:12.874001 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-20bd1bb6-2327-46a8-b2a3-37bd6909e547 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: fbe881d3-e162-43fb-a5d8-0c954d016ad3] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:43:12.881059 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-20bd1bb6-2327-46a8-b2a3-37bd6909e547 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:12.881540 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-20bd1bb6-2327-46a8-b2a3-37bd6909e547 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:12.882314 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-20bd1bb6-2327-46a8-b2a3-37bd6909e547 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:12.882748 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-20bd1bb6-2327-46a8-b2a3-37bd6909e547 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:13.016298 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-20bd1bb6-2327-46a8-b2a3-37bd6909e547 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa4a2a39deb4e7ba54032acec14e029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc560e8b75194743bbb46d903b481357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:43:13.023954 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-20bd1bb6-2327-46a8-b2a3-37bd6909e547 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "GET /compute/v2.1/servers/fbe881d3-e162-43fb-a5d8-0c954d016ad3" status: 200 len: 1680 microversion: 2.1 time: 0.156487 May 19 13:43:13.024550 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 474/963] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:43:12 2022] GET /compute/v2.1/servers/fbe881d3-e162-43fb-a5d8-0c954d016ad3 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:43:13.126327 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-527cda8b-8733-4f4f-b880-df84d2757982 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:43:13.127230 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-527cda8b-8733-4f4f-b880-df84d2757982 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] [instance: e04724e3-bd2a-49a5-bad8-c9d186bc7211] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:43:13.138465 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-527cda8b-8733-4f4f-b880-df84d2757982 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:13.138937 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-527cda8b-8733-4f4f-b880-df84d2757982 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:13.139694 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-527cda8b-8733-4f4f-b880-df84d2757982 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:13.140120 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-527cda8b-8733-4f4f-b880-df84d2757982 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:13.276041 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-527cda8b-8733-4f4f-b880-df84d2757982 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0a4b41707d444581ee0aa2296ac0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ad7b921dbc4a8d9e9be0d50385deee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:43:13.284314 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-527cda8b-8733-4f4f-b880-df84d2757982 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] 10.222.0.24 "GET /compute/v2.1/servers/e04724e3-bd2a-49a5-bad8-c9d186bc7211" status: 200 len: 1576 microversion: 2.1 time: 0.164637 May 19 13:43:13.284869 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 490/964] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:43:13 2022] GET /compute/v2.1/servers/e04724e3-bd2a-49a5-bad8-c9d186bc7211 => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:43:14.042844 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-9bb5bd57-40aa-4872-bb60-1154ce62362c tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:43:14.043751 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-9bb5bd57-40aa-4872-bb60-1154ce62362c tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: fbe881d3-e162-43fb-a5d8-0c954d016ad3] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:43:14.050969 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-9bb5bd57-40aa-4872-bb60-1154ce62362c tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:14.051443 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-9bb5bd57-40aa-4872-bb60-1154ce62362c tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:14.052169 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-9bb5bd57-40aa-4872-bb60-1154ce62362c tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:14.052803 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-9bb5bd57-40aa-4872-bb60-1154ce62362c tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:14.281091 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [req-a6042402-e1e6-4317-84d3-463d780fcfb9 req-af3edc82-fe38-42ae-b42f-5d94c2b9e995 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e04724e3-bd2a-49a5-bad8-c9d186bc7211", "name": "network-vif-deleted", "tag": "c0ab3804-fc2a-4ea2-b784-19b69d342b58"}]} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:43:14.291436 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-a6042402-e1e6-4317-84d3-463d780fcfb9 req-af3edc82-fe38-42ae-b42f-5d94c2b9e995 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:14.292396 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-a6042402-e1e6-4317-84d3-463d780fcfb9 req-af3edc82-fe38-42ae-b42f-5d94c2b9e995 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:14.317910 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.compute.server_external_events [req-a6042402-e1e6-4317-84d3-463d780fcfb9 req-af3edc82-fe38-42ae-b42f-5d94c2b9e995 service nova] Creating event network-vif-deleted:c0ab3804-fc2a-4ea2-b784-19b69d342b58 for instance e04724e3-bd2a-49a5-bad8-c9d186bc7211 on hv-cinder-84112 May 19 13:43:14.323778 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [req-a6042402-e1e6-4317-84d3-463d780fcfb9 req-af3edc82-fe38-42ae-b42f-5d94c2b9e995 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047699 May 19 13:43:14.324962 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 491/965] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:43:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:43:14.331318 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-65599250-2ed9-4bc7-af8e-84d00085fe6f tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:43:14.332038 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-65599250-2ed9-4bc7-af8e-84d00085fe6f tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] [instance: e04724e3-bd2a-49a5-bad8-c9d186bc7211] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:43:14.338719 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-65599250-2ed9-4bc7-af8e-84d00085fe6f tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:14.339167 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-65599250-2ed9-4bc7-af8e-84d00085fe6f tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:14.339977 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-65599250-2ed9-4bc7-af8e-84d00085fe6f tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:14.340369 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-65599250-2ed9-4bc7-af8e-84d00085fe6f tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:14.395366 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-9bb5bd57-40aa-4872-bb60-1154ce62362c tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa4a2a39deb4e7ba54032acec14e029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc560e8b75194743bbb46d903b481357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:43:14.403071 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-9bb5bd57-40aa-4872-bb60-1154ce62362c tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "GET /compute/v2.1/servers/fbe881d3-e162-43fb-a5d8-0c954d016ad3" status: 200 len: 1680 microversion: 2.1 time: 0.364175 May 19 13:43:14.403650 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 475/966] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:43:14 2022] GET /compute/v2.1/servers/fbe881d3-e162-43fb-a5d8-0c954d016ad3 => generated 1680 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:43:14.407037 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-65599250-2ed9-4bc7-af8e-84d00085fe6f tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0a4b41707d444581ee0aa2296ac0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ad7b921dbc4a8d9e9be0d50385deee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:43:14.415238 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:43:14.420656 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-65599250-2ed9-4bc7-af8e-84d00085fe6f tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] 10.222.0.24 "GET /compute/v2.1/servers/e04724e3-bd2a-49a5-bad8-c9d186bc7211" status: 200 len: 1225 microversion: 2.1 time: 0.094461 May 19 13:43:14.421633 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 492/967] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:43:14 2022] GET /compute/v2.1/servers/e04724e3-bd2a-49a5-bad8-c9d186bc7211 => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:43:14.892209 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [req-77a46ce8-219a-4618-bfae-8d8b46718b7e req-fc86d990-b7b6-43e5-bfec-1ffb522e4cdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbe881d3-e162-43fb-a5d8-0c954d016ad3", "name": "network-vif-deleted", "tag": "b9843349-3c7d-462a-a582-ab4d30a6e9f1"}]} {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:43:14.901230 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [req-77a46ce8-219a-4618-bfae-8d8b46718b7e req-fc86d990-b7b6-43e5-bfec-1ffb522e4cdf service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:14.901910 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [req-77a46ce8-219a-4618-bfae-8d8b46718b7e req-fc86d990-b7b6-43e5-bfec-1ffb522e4cdf service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:14.913100 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.compute.server_external_events [req-77a46ce8-219a-4618-bfae-8d8b46718b7e req-fc86d990-b7b6-43e5-bfec-1ffb522e4cdf service nova] Creating event network-vif-deleted:b9843349-3c7d-462a-a582-ab4d30a6e9f1 for instance fbe881d3-e162-43fb-a5d8-0c954d016ad3 on hv-cinder-84112 May 19 13:43:14.918342 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [req-77a46ce8-219a-4618-bfae-8d8b46718b7e req-fc86d990-b7b6-43e5-bfec-1ffb522e4cdf service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030023 May 19 13:43:14.918938 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 476/968] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:43:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:43:15.421433 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-cdeafa05-af66-4c2b-817a-0a3c78c98ad4 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:43:15.422057 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-cdeafa05-af66-4c2b-817a-0a3c78c98ad4 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: fbe881d3-e162-43fb-a5d8-0c954d016ad3] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:43:15.430205 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-cdeafa05-af66-4c2b-817a-0a3c78c98ad4 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:15.430660 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-cdeafa05-af66-4c2b-817a-0a3c78c98ad4 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:15.431474 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-cdeafa05-af66-4c2b-817a-0a3c78c98ad4 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:15.431915 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-cdeafa05-af66-4c2b-817a-0a3c78c98ad4 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:15.441334 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-aa831f62-202c-47d4-90fe-c7b21d046f70 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:43:15.442681 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-aa831f62-202c-47d4-90fe-c7b21d046f70 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] [instance: e04724e3-bd2a-49a5-bad8-c9d186bc7211] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:43:15.449219 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-aa831f62-202c-47d4-90fe-c7b21d046f70 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:15.449692 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-aa831f62-202c-47d4-90fe-c7b21d046f70 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:15.450725 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-aa831f62-202c-47d4-90fe-c7b21d046f70 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:15.451562 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-aa831f62-202c-47d4-90fe-c7b21d046f70 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:15.468629 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.wsgi [None req-aa831f62-202c-47d4-90fe-c7b21d046f70 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] HTTP exception thrown: Instance e04724e3-bd2a-49a5-bad8-c9d186bc7211 could not be found. May 19 13:43:15.470523 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-aa831f62-202c-47d4-90fe-c7b21d046f70 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Request method failure captured: May 19 13:43:15.470523 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: request: GET /compute/v2.1/servers/e04724e3-bd2a-49a5-bad8-c9d186bc7211 HTTP/1.1 May 19 13:43:15.470523 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Accept: application/json May 19 13:43:15.470523 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Accept-Encoding: identity May 19 13:43:15.470523 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Connection: close May 19 13:43:15.470523 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Content-Length: 0 May 19 13:43:15.470523 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Content-Type: application/json May 19 13:43:15.470523 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Host: 10.222.0.24 May 19 13:43:15.470523 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Openstack-System-Scope: None May 19 13:43:15.470523 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: User-Agent: python-urllib3/1.26.9 May 19 13:43:15.470523 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Auth-Token: gAAAAABihkfZZi3CO4kgMRQyXdYId70aYnRUeD_PBCoZE9_U-eSRdPDJ8U-K8FIgr4iKsCo_31Ll0TF-QRYIfsMapwxYbX4ntNVtGmD2GqJq7AavkFVumf5rk50QPpfFewjlRyH5ReYCECCj_Fybs53mzU-L1x3JDP2S0BBbSe44_2Eh-84z8Aw May 19 13:43:15.470523 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Domain-Id: None May 19 13:43:15.470523 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Domain-Name: None May 19 13:43:15.470523 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Identity-Status: Confirmed May 19 13:43:15.470523 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Is-Admin-Project: True May 19 13:43:15.470523 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Domain-Id: default May 19 13:43:15.470523 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Domain-Name: Default May 19 13:43:15.470523 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Id: 98ad7b921dbc4a8d9e9be0d50385deee May 19 13:43:15.470523 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Name: tempest-TestVolumeBootPattern-1301025888 May 19 13:43:15.470523 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Role: reader,member May 19 13:43:15.470523 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Roles: reader,member May 19 13:43:15.472028 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/98ad7b921dbc4a8d9e9be0d50385deee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/98ad7b921dbc4a8d9e9be0d50385deee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_98ad7b921dbc4a8d9e9be0d50385deee", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/98ad7b921dbc4a8d9e9be0d50385deee"}]}] May 19 13:43:15.472028 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant: tempest-TestVolumeBootPattern-1301025888 May 19 13:43:15.472028 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant-Id: 98ad7b921dbc4a8d9e9be0d50385deee May 19 13:43:15.472028 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant-Name: tempest-TestVolumeBootPattern-1301025888 May 19 13:43:15.472028 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User: tempest-TestVolumeBootPattern-1301025888-project May 19 13:43:15.472028 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Domain-Id: default May 19 13:43:15.472028 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Domain-Name: Default May 19 13:43:15.472028 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Id: aa0a4b41707d444581ee0aa2296ac0ba May 19 13:43:15.472028 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Name: tempest-TestVolumeBootPattern-1301025888-project May 19 13:43:15.472028 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: method: > May 19 13:43:15.472028 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: exception: Instance e04724e3-bd2a-49a5-bad8-c9d186bc7211 could not be found. May 19 13:43:15.472028 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: action_args: {'id': 'e04724e3-bd2a-49a5-bad8-c9d186bc7211'} May 19 13:43:15.472867 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:43:15.472867 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:43:15.472867 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 13:43:15.472867 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 13:43:15.472867 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 13:43:15.472867 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 13:43:15.472867 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 13:43:15.472867 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 13:43:15.472867 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 13:43:15.472867 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 13:43:15.472867 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e04724e3-bd2a-49a5-bad8-c9d186bc7211 could not be found. May 19 13:43:15.472867 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:43:15.472867 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:43:15.472867 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:43:15.472867 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:43:15.472867 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:43:15.472867 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:43:15.472867 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:43:15.472867 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:43:15.472867 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:43:15.474191 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:43:15.474191 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 13:43:15.474191 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 13:43:15.474191 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 13:43:15.474191 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 13:43:15.474191 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 13:43:15.474191 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 13:43:15.474191 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e04724e3-bd2a-49a5-bad8-c9d186bc7211 could not be found. May 19 13:43:15.474191 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:43:15.474191 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:43:15.474191 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:43:15.474191 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:43:15.474191 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:43:15.474191 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:43:15.474191 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:43:15.474191 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:43:15.474191 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e04724e3-bd2a-49a5-bad8-c9d186bc7211 could not be found. May 19 13:43:15.474191 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:43:15.476976 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-aa831f62-202c-47d4-90fe-c7b21d046f70 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Returning 404 to user: Instance e04724e3-bd2a-49a5-bad8-c9d186bc7211 could not be found. {{(pid=120472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:43:15.476976 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-aa831f62-202c-47d4-90fe-c7b21d046f70 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] 10.222.0.24 "GET /compute/v2.1/servers/e04724e3-bd2a-49a5-bad8-c9d186bc7211" status: 404 len: 111 microversion: 2.1 time: 0.036719 May 19 13:43:15.477164 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-cdeafa05-af66-4c2b-817a-0a3c78c98ad4 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:15.477164 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-cdeafa05-af66-4c2b-817a-0a3c78c98ad4 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:15.477164 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.objects.instance [None req-cdeafa05-af66-4c2b-817a-0a3c78c98ad4 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lazy-loading 'fault' on Instance uuid fbe881d3-e162-43fb-a5d8-0c954d016ad3 {{(pid=120471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 13:43:15.477696 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 477/969] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:43:15 2022] GET /compute/v2.1/servers/e04724e3-bd2a-49a5-bad8-c9d186bc7211 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 13:43:15.522420 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-cdeafa05-af66-4c2b-817a-0a3c78c98ad4 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa4a2a39deb4e7ba54032acec14e029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc560e8b75194743bbb46d903b481357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:43:15.530153 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-cdeafa05-af66-4c2b-817a-0a3c78c98ad4 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "GET /compute/v2.1/servers/fbe881d3-e162-43fb-a5d8-0c954d016ad3" status: 200 len: 1330 microversion: 2.1 time: 0.113448 May 19 13:43:15.539808 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 493/970] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:43:15 2022] GET /compute/v2.1/servers/fbe881d3-e162-43fb-a5d8-0c954d016ad3 => generated 1330 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:43:15.971533 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-5c7cf44e-3382-4b04-8ca5-5261229b22e8 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:43:15.972018 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-5c7cf44e-3382-4b04-8ca5-5261229b22e8 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] [instance: 9ffb3760-1c38-48de-abb9-ac0e14389d8f] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:43:15.978362 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-5c7cf44e-3382-4b04-8ca5-5261229b22e8 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:15.978796 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-5c7cf44e-3382-4b04-8ca5-5261229b22e8 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:15.979568 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-5c7cf44e-3382-4b04-8ca5-5261229b22e8 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:15.980018 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-5c7cf44e-3382-4b04-8ca5-5261229b22e8 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:15.994139 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.wsgi [None req-5c7cf44e-3382-4b04-8ca5-5261229b22e8 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] HTTP exception thrown: Instance 9ffb3760-1c38-48de-abb9-ac0e14389d8f could not be found. May 19 13:43:15.995712 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-5c7cf44e-3382-4b04-8ca5-5261229b22e8 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Request method failure captured: May 19 13:43:15.995712 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: request: DELETE /compute/v2.1/servers/9ffb3760-1c38-48de-abb9-ac0e14389d8f HTTP/1.1 May 19 13:43:15.995712 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Accept: application/json May 19 13:43:15.995712 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Accept-Encoding: identity May 19 13:43:15.995712 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Connection: close May 19 13:43:15.995712 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Content-Length: 0 May 19 13:43:15.995712 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Content-Type: application/json May 19 13:43:15.995712 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Host: 10.222.0.24 May 19 13:43:15.995712 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Openstack-System-Scope: None May 19 13:43:15.995712 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: User-Agent: python-urllib3/1.26.9 May 19 13:43:15.995712 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Auth-Token: gAAAAABihkfZZi3CO4kgMRQyXdYId70aYnRUeD_PBCoZE9_U-eSRdPDJ8U-K8FIgr4iKsCo_31Ll0TF-QRYIfsMapwxYbX4ntNVtGmD2GqJq7AavkFVumf5rk50QPpfFewjlRyH5ReYCECCj_Fybs53mzU-L1x3JDP2S0BBbSe44_2Eh-84z8Aw May 19 13:43:15.995712 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Domain-Id: None May 19 13:43:15.995712 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Domain-Name: None May 19 13:43:15.995712 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Identity-Status: Confirmed May 19 13:43:15.995712 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Is-Admin-Project: True May 19 13:43:15.995712 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Domain-Id: default May 19 13:43:15.995712 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Domain-Name: Default May 19 13:43:15.995712 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Id: 98ad7b921dbc4a8d9e9be0d50385deee May 19 13:43:15.995712 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Name: tempest-TestVolumeBootPattern-1301025888 May 19 13:43:15.995712 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Role: reader,member May 19 13:43:15.995712 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Roles: reader,member May 19 13:43:15.997369 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/98ad7b921dbc4a8d9e9be0d50385deee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/98ad7b921dbc4a8d9e9be0d50385deee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_98ad7b921dbc4a8d9e9be0d50385deee", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/98ad7b921dbc4a8d9e9be0d50385deee"}]}] May 19 13:43:15.997369 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant: tempest-TestVolumeBootPattern-1301025888 May 19 13:43:15.997369 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant-Id: 98ad7b921dbc4a8d9e9be0d50385deee May 19 13:43:15.997369 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant-Name: tempest-TestVolumeBootPattern-1301025888 May 19 13:43:15.997369 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User: tempest-TestVolumeBootPattern-1301025888-project May 19 13:43:15.997369 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Domain-Id: default May 19 13:43:15.997369 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Domain-Name: Default May 19 13:43:15.997369 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Id: aa0a4b41707d444581ee0aa2296ac0ba May 19 13:43:15.997369 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Name: tempest-TestVolumeBootPattern-1301025888-project May 19 13:43:15.997369 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: method: > May 19 13:43:15.997369 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: exception: Instance 9ffb3760-1c38-48de-abb9-ac0e14389d8f could not be found. May 19 13:43:15.997369 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: action_args: {'id': '9ffb3760-1c38-48de-abb9-ac0e14389d8f'} May 19 13:43:15.998370 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:43:15.998370 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:43:15.998370 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 13:43:15.998370 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 13:43:15.998370 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 13:43:15.998370 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 13:43:15.998370 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 13:43:15.998370 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 13:43:15.998370 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 13:43:15.998370 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 13:43:15.998370 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ffb3760-1c38-48de-abb9-ac0e14389d8f could not be found. May 19 13:43:15.998370 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:43:15.998370 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:43:15.998370 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:43:15.998370 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:43:15.998370 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:43:15.998370 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:43:15.998370 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:43:15.998370 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:43:15.998370 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:43:15.999898 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:43:15.999898 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 13:43:15.999898 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 13:43:15.999898 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 13:43:15.999898 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 13:43:15.999898 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 13:43:15.999898 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 13:43:15.999898 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 13:43:15.999898 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 13:43:15.999898 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ffb3760-1c38-48de-abb9-ac0e14389d8f could not be found. May 19 13:43:15.999898 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:43:15.999898 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:43:15.999898 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:43:15.999898 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:43:15.999898 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:43:15.999898 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:43:15.999898 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:43:15.999898 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:43:15.999898 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ffb3760-1c38-48de-abb9-ac0e14389d8f could not be found. May 19 13:43:15.999898 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:43:16.001452 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-5c7cf44e-3382-4b04-8ca5-5261229b22e8 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Returning 404 to user: Instance 9ffb3760-1c38-48de-abb9-ac0e14389d8f could not be found. {{(pid=120472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:43:16.001452 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-5c7cf44e-3382-4b04-8ca5-5261229b22e8 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] 10.222.0.24 "DELETE /compute/v2.1/servers/9ffb3760-1c38-48de-abb9-ac0e14389d8f" status: 404 len: 111 microversion: 2.1 time: 0.029541 May 19 13:43:16.001452 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 478/971] 10.222.0.24 () {58 vars in 1238 bytes} [Thu May 19 13:43:15 2022] DELETE /compute/v2.1/servers/9ffb3760-1c38-48de-abb9-ac0e14389d8f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 13:43:16.006767 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-77726dc0-f42b-430b-b2f5-8bdbf527a92a tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:43:16.007766 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-77726dc0-f42b-430b-b2f5-8bdbf527a92a tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] [instance: 9ffb3760-1c38-48de-abb9-ac0e14389d8f] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:43:16.015125 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-77726dc0-f42b-430b-b2f5-8bdbf527a92a tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:16.015586 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-77726dc0-f42b-430b-b2f5-8bdbf527a92a tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:16.016380 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-77726dc0-f42b-430b-b2f5-8bdbf527a92a tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:16.016808 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-77726dc0-f42b-430b-b2f5-8bdbf527a92a tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:16.031347 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.wsgi [None req-77726dc0-f42b-430b-b2f5-8bdbf527a92a tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] HTTP exception thrown: Instance 9ffb3760-1c38-48de-abb9-ac0e14389d8f could not be found. May 19 13:43:16.033103 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-77726dc0-f42b-430b-b2f5-8bdbf527a92a tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Request method failure captured: May 19 13:43:16.033103 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: request: GET /compute/v2.1/servers/9ffb3760-1c38-48de-abb9-ac0e14389d8f HTTP/1.1 May 19 13:43:16.033103 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Accept: application/json May 19 13:43:16.033103 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Accept-Encoding: identity May 19 13:43:16.033103 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Connection: close May 19 13:43:16.033103 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Content-Length: 0 May 19 13:43:16.033103 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Content-Type: application/json May 19 13:43:16.033103 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Host: 10.222.0.24 May 19 13:43:16.033103 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Openstack-System-Scope: None May 19 13:43:16.033103 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: User-Agent: python-urllib3/1.26.9 May 19 13:43:16.033103 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Auth-Token: gAAAAABihkfZZi3CO4kgMRQyXdYId70aYnRUeD_PBCoZE9_U-eSRdPDJ8U-K8FIgr4iKsCo_31Ll0TF-QRYIfsMapwxYbX4ntNVtGmD2GqJq7AavkFVumf5rk50QPpfFewjlRyH5ReYCECCj_Fybs53mzU-L1x3JDP2S0BBbSe44_2Eh-84z8Aw May 19 13:43:16.033103 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Domain-Id: None May 19 13:43:16.033103 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Domain-Name: None May 19 13:43:16.033103 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Identity-Status: Confirmed May 19 13:43:16.033103 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Is-Admin-Project: True May 19 13:43:16.033103 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Domain-Id: default May 19 13:43:16.033103 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Domain-Name: Default May 19 13:43:16.033103 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Id: 98ad7b921dbc4a8d9e9be0d50385deee May 19 13:43:16.033103 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Name: tempest-TestVolumeBootPattern-1301025888 May 19 13:43:16.033103 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Role: reader,member May 19 13:43:16.033103 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Roles: reader,member May 19 13:43:16.034836 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/98ad7b921dbc4a8d9e9be0d50385deee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/98ad7b921dbc4a8d9e9be0d50385deee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_98ad7b921dbc4a8d9e9be0d50385deee", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/98ad7b921dbc4a8d9e9be0d50385deee"}]}] May 19 13:43:16.034836 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Tenant: tempest-TestVolumeBootPattern-1301025888 May 19 13:43:16.034836 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Tenant-Id: 98ad7b921dbc4a8d9e9be0d50385deee May 19 13:43:16.034836 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Tenant-Name: tempest-TestVolumeBootPattern-1301025888 May 19 13:43:16.034836 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User: tempest-TestVolumeBootPattern-1301025888-project May 19 13:43:16.034836 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Domain-Id: default May 19 13:43:16.034836 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Domain-Name: Default May 19 13:43:16.034836 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Id: aa0a4b41707d444581ee0aa2296ac0ba May 19 13:43:16.034836 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Name: tempest-TestVolumeBootPattern-1301025888-project May 19 13:43:16.034836 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: method: > May 19 13:43:16.034836 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: exception: Instance 9ffb3760-1c38-48de-abb9-ac0e14389d8f could not be found. May 19 13:43:16.034836 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: action_args: {'id': '9ffb3760-1c38-48de-abb9-ac0e14389d8f'} May 19 13:43:16.035808 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:43:16.035808 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:43:16.035808 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 13:43:16.035808 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 13:43:16.035808 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 13:43:16.035808 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 13:43:16.035808 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 13:43:16.035808 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 13:43:16.035808 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 13:43:16.035808 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 13:43:16.035808 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ffb3760-1c38-48de-abb9-ac0e14389d8f could not be found. May 19 13:43:16.035808 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:43:16.035808 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:43:16.035808 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:43:16.035808 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:43:16.035808 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:43:16.035808 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:43:16.035808 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:43:16.035808 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:43:16.035808 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:43:16.037041 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:43:16.037041 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 13:43:16.037041 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 13:43:16.037041 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 13:43:16.037041 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 13:43:16.037041 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 13:43:16.037041 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 13:43:16.037041 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ffb3760-1c38-48de-abb9-ac0e14389d8f could not be found. May 19 13:43:16.037041 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:43:16.037041 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:43:16.037041 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:43:16.037041 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:43:16.037041 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:43:16.037041 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:43:16.037041 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:43:16.037041 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:43:16.037041 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ffb3760-1c38-48de-abb9-ac0e14389d8f could not be found. May 19 13:43:16.037041 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:43:16.038368 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-77726dc0-f42b-430b-b2f5-8bdbf527a92a tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Returning 404 to user: Instance 9ffb3760-1c38-48de-abb9-ac0e14389d8f could not be found. {{(pid=120471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:43:16.038368 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-77726dc0-f42b-430b-b2f5-8bdbf527a92a tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] 10.222.0.24 "GET /compute/v2.1/servers/9ffb3760-1c38-48de-abb9-ac0e14389d8f" status: 404 len: 111 microversion: 2.1 time: 0.031889 May 19 13:43:16.038368 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 494/972] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:43:16 2022] GET /compute/v2.1/servers/9ffb3760-1c38-48de-abb9-ac0e14389d8f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 13:43:16.551359 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-57171d06-2521-42f9-8e86-9d06f563bfe2 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:43:16.552155 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-57171d06-2521-42f9-8e86-9d06f563bfe2 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: fbe881d3-e162-43fb-a5d8-0c954d016ad3] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:43:16.561535 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-57171d06-2521-42f9-8e86-9d06f563bfe2 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:16.561979 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-57171d06-2521-42f9-8e86-9d06f563bfe2 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:16.562724 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-57171d06-2521-42f9-8e86-9d06f563bfe2 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:16.563155 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-57171d06-2521-42f9-8e86-9d06f563bfe2 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:16.576935 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.wsgi [None req-57171d06-2521-42f9-8e86-9d06f563bfe2 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] HTTP exception thrown: Instance fbe881d3-e162-43fb-a5d8-0c954d016ad3 could not be found. May 19 13:43:16.578473 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-57171d06-2521-42f9-8e86-9d06f563bfe2 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Request method failure captured: May 19 13:43:16.578473 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: request: GET /compute/v2.1/servers/fbe881d3-e162-43fb-a5d8-0c954d016ad3 HTTP/1.1 May 19 13:43:16.578473 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Accept: application/json May 19 13:43:16.578473 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Accept-Encoding: identity May 19 13:43:16.578473 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Connection: close May 19 13:43:16.578473 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Content-Length: 0 May 19 13:43:16.578473 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Content-Type: application/json May 19 13:43:16.578473 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Host: 10.222.0.24 May 19 13:43:16.578473 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Openstack-System-Scope: None May 19 13:43:16.578473 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: User-Agent: python-urllib3/1.26.9 May 19 13:43:16.578473 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Auth-Token: gAAAAABihkj6liBLvukkw2qtst-UG_cKJZiNcCgt6W_kQDYluV0QF-s3L61GELG86yuBU_XP0oEocHGYFB77RCnoJWx_PSe5oCa2SU8RfG2VbbO9_x7MK34OtxqKFCLvWQmkpMAhKbbulm_ByBEFHwsuhM1s6duzmOYoRlcr_Dq0_GCOhJ038Nk May 19 13:43:16.578473 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Domain-Id: None May 19 13:43:16.578473 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Domain-Name: None May 19 13:43:16.578473 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Identity-Status: Confirmed May 19 13:43:16.578473 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Is-Admin-Project: True May 19 13:43:16.578473 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Domain-Id: default May 19 13:43:16.578473 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Domain-Name: Default May 19 13:43:16.578473 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Id: bc560e8b75194743bbb46d903b481357 May 19 13:43:16.578473 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Name: tempest-AttachVolumeNegativeTest-35839424 May 19 13:43:16.578473 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Role: reader,member May 19 13:43:16.578473 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Roles: reader,member May 19 13:43:16.580130 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/bc560e8b75194743bbb46d903b481357"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/bc560e8b75194743bbb46d903b481357"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_bc560e8b75194743bbb46d903b481357", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/bc560e8b75194743bbb46d903b481357"}]}] May 19 13:43:16.580130 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant: tempest-AttachVolumeNegativeTest-35839424 May 19 13:43:16.580130 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant-Id: bc560e8b75194743bbb46d903b481357 May 19 13:43:16.580130 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-35839424 May 19 13:43:16.580130 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User: tempest-AttachVolumeNegativeTest-35839424-project May 19 13:43:16.580130 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Domain-Id: default May 19 13:43:16.580130 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Domain-Name: Default May 19 13:43:16.580130 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Id: daa4a2a39deb4e7ba54032acec14e029 May 19 13:43:16.580130 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Name: tempest-AttachVolumeNegativeTest-35839424-project May 19 13:43:16.580130 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: method: > May 19 13:43:16.580130 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: exception: Instance fbe881d3-e162-43fb-a5d8-0c954d016ad3 could not be found. May 19 13:43:16.580130 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: action_args: {'id': 'fbe881d3-e162-43fb-a5d8-0c954d016ad3'} May 19 13:43:16.580938 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:43:16.580938 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:43:16.580938 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 13:43:16.580938 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 13:43:16.580938 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 13:43:16.580938 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 13:43:16.580938 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 13:43:16.580938 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 13:43:16.580938 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 13:43:16.580938 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 13:43:16.580938 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbe881d3-e162-43fb-a5d8-0c954d016ad3 could not be found. May 19 13:43:16.580938 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:43:16.580938 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:43:16.580938 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:43:16.580938 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:43:16.580938 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:43:16.580938 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:43:16.580938 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:43:16.580938 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:43:16.580938 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:43:16.582234 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:43:16.582234 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 13:43:16.582234 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 13:43:16.582234 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 13:43:16.582234 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 13:43:16.582234 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 13:43:16.582234 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 13:43:16.582234 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbe881d3-e162-43fb-a5d8-0c954d016ad3 could not be found. May 19 13:43:16.582234 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:43:16.582234 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:43:16.582234 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:43:16.582234 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:43:16.582234 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:43:16.582234 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:43:16.582234 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:43:16.582234 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:43:16.582234 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbe881d3-e162-43fb-a5d8-0c954d016ad3 could not be found. May 19 13:43:16.582234 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:43:16.583397 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-57171d06-2521-42f9-8e86-9d06f563bfe2 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Returning 404 to user: Instance fbe881d3-e162-43fb-a5d8-0c954d016ad3 could not be found. {{(pid=120472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:43:16.583397 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-57171d06-2521-42f9-8e86-9d06f563bfe2 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "GET /compute/v2.1/servers/fbe881d3-e162-43fb-a5d8-0c954d016ad3" status: 404 len: 111 microversion: 2.1 time: 0.034634 May 19 13:43:16.583397 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 479/973] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:43:16 2022] GET /compute/v2.1/servers/fbe881d3-e162-43fb-a5d8-0c954d016ad3 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 13:43:16.588715 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-a2161e59-f82f-458c-98a8-c389d7139bec tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Calling method '.version_select at 0x7f7c2a541550>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:43:16.608961 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-a2161e59-f82f-458c-98a8-c389d7139bec tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-223621523" status: 202 len: 0 microversion: 2.1 time: 0.024080 May 19 13:43:16.609530 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 495/974] 10.222.0.24 () {58 vars in 1217 bytes} [Thu May 19 13:43:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-223621523 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 13:43:17.260533 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-0ac1e88f-8ef6-45c5-9d53-0314e07ce5c3 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Action: 'create', calling method: .version_select at 0x7f7c2a5dda60>, body: {"keypair": {"name": "tempest-keypair-1008282767", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCOULZ6q1ACOCWXjX24XCnZ5xxKagOttxL24ZIoY8JzrvgLr0Es48zx2bVDSYbPiPPuwZL5hL6ZJ+GJYWyj18Fq9ePht+Uh/CQzzP/zaPIXy6oUx0oEkOumOvTrc79jMmg=="}} {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:43:17.275614 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.quota [None req-0ac1e88f-8ef6-45c5-9d53-0314e07ce5c3 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Getting quotas for project bc560e8b75194743bbb46d903b481357. Resources: {'key_pairs'} {{(pid=120472) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 13:43:17.280299 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.quota [None req-0ac1e88f-8ef6-45c5-9d53-0314e07ce5c3 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Getting quotas for user daa4a2a39deb4e7ba54032acec14e029 and project bc560e8b75194743bbb46d903b481357. Resources: {'key_pairs'} {{(pid=120472) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 13:43:17.304899 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-0ac1e88f-8ef6-45c5-9d53-0314e07ce5c3 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048569 May 19 13:43:17.305660 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 480/975] 10.222.0.24 () {60 vars in 1158 bytes} [Thu May 19 13:43:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:43:17.371337 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-ed53132e-6448-41c6-a916-67f88e22eb74 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] Calling method '.version_select at 0x7f7c2af02af0>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:43:17.405914 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-ed53132e-6448-41c6-a916-67f88e22eb74 tempest-TestVolumeBootPattern-1301025888 tempest-TestVolumeBootPattern-1301025888-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1595031897" status: 202 len: 0 microversion: 2.1 time: 0.038436 May 19 13:43:17.406518 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 496/976] 10.222.0.24 () {58 vars in 1262 bytes} [Thu May 19 13:43:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1595031897 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 13:43:18.593600 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-4dd72209-02e8-422e-84b0-aa10cbfb6046 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-357871018", "imageRef": "9beb860d-9c3f-4244-80aa-71a9c337a429", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "39a38089-655e-4b34-b99f-11a97c39ff7d"}], "security_groups": [{"name": "tempest-securitygroup--902445762"}], "key_name": "tempest-keypair-1008282767", "user_data": "}} {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:43:19.013327 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.network.neutron [None req-4dd72209-02e8-422e-84b0-aa10cbfb6046 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] validate_networks() for [('39a38089-655e-4b34-b99f-11a97c39ff7d', None, None, None, None, None)] {{(pid=120472) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 13:43:19.684658 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.virt.hardware [None req-4dd72209-02e8-422e-84b0-aa10cbfb6046 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Flavor limits 0:0:0 {{(pid=120472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 13:43:19.686556 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.virt.hardware [None req-4dd72209-02e8-422e-84b0-aa10cbfb6046 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Image limits 0:0:0 {{(pid=120472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 13:43:19.687368 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.virt.hardware [None req-4dd72209-02e8-422e-84b0-aa10cbfb6046 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Flavor pref 0:0:0 {{(pid=120472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 13:43:19.687860 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.virt.hardware [None req-4dd72209-02e8-422e-84b0-aa10cbfb6046 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Image pref 0:0:0 {{(pid=120472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 13:43:19.688369 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.virt.hardware [None req-4dd72209-02e8-422e-84b0-aa10cbfb6046 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 13:43:19.697849 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-4dd72209-02e8-422e-84b0-aa10cbfb6046 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:19.698415 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-4dd72209-02e8-422e-84b0-aa10cbfb6046 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:19.699294 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-4dd72209-02e8-422e-84b0-aa10cbfb6046 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:19.699962 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-4dd72209-02e8-422e-84b0-aa10cbfb6046 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:19.719073 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.quota [None req-4dd72209-02e8-422e-84b0-aa10cbfb6046 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Getting quotas for project bc560e8b75194743bbb46d903b481357. Resources: {'instances', 'cores', 'ram'} {{(pid=120472) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 13:43:19.724427 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.quota [None req-4dd72209-02e8-422e-84b0-aa10cbfb6046 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Getting quotas for user daa4a2a39deb4e7ba54032acec14e029 and project bc560e8b75194743bbb46d903b481357. Resources: {'instances', 'cores', 'ram'} {{(pid=120472) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 13:43:19.740558 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-4dd72209-02e8-422e-84b0-aa10cbfb6046 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Going to run 1 instances... {{(pid=120472) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 13:43:19.743189 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-4dd72209-02e8-422e-84b0-aa10cbfb6046 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: 69b0d8dd-4d36-4174-991d-46f31a266b9f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9beb860d-9c3f-4244-80aa-71a9c337a429',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120472) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 13:43:19.793807 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-4dd72209-02e8-422e-84b0-aa10cbfb6046 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.205040 May 19 13:43:19.799805 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 481/977] 10.222.0.24 () {60 vars in 1146 bytes} [Thu May 19 13:43:18 2022] POST /compute/v2.1/servers => generated 401 bytes in 1207 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 13:43:19.805452 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-5fa2442e-d7bf-4c5f-8ea3-063e8dc276e8 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:43:19.806295 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-5fa2442e-d7bf-4c5f-8ea3-063e8dc276e8 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: 69b0d8dd-4d36-4174-991d-46f31a266b9f] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:43:19.897480 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-5fa2442e-d7bf-4c5f-8ea3-063e8dc276e8 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa4a2a39deb4e7ba54032acec14e029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc560e8b75194743bbb46d903b481357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:43:19.904720 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-5fa2442e-d7bf-4c5f-8ea3-063e8dc276e8 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "GET /compute/v2.1/servers/69b0d8dd-4d36-4174-991d-46f31a266b9f" status: 200 len: 1241 microversion: 2.1 time: 0.103541 May 19 13:43:19.906135 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 497/978] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:43:19 2022] GET /compute/v2.1/servers/69b0d8dd-4d36-4174-991d-46f31a266b9f => generated 1241 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:43:20.924749 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-3622fee3-b08d-43ee-847f-60ffba05b559 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:43:20.926056 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-3622fee3-b08d-43ee-847f-60ffba05b559 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: 69b0d8dd-4d36-4174-991d-46f31a266b9f] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:43:20.946788 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-3622fee3-b08d-43ee-847f-60ffba05b559 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:20.948751 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-3622fee3-b08d-43ee-847f-60ffba05b559 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:20.949889 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-3622fee3-b08d-43ee-847f-60ffba05b559 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:20.951389 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-3622fee3-b08d-43ee-847f-60ffba05b559 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:21.081228 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-3622fee3-b08d-43ee-847f-60ffba05b559 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa4a2a39deb4e7ba54032acec14e029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc560e8b75194743bbb46d903b481357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:43:21.089335 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-3622fee3-b08d-43ee-847f-60ffba05b559 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "GET /compute/v2.1/servers/69b0d8dd-4d36-4174-991d-46f31a266b9f" status: 200 len: 1301 microversion: 2.1 time: 0.170966 May 19 13:43:21.090321 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 482/979] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:43:20 2022] GET /compute/v2.1/servers/69b0d8dd-4d36-4174-991d-46f31a266b9f => generated 1301 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:43:22.109495 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-68de46a3-58bc-4388-8d60-ad083c7bfc11 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:43:22.111912 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-68de46a3-58bc-4388-8d60-ad083c7bfc11 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: 69b0d8dd-4d36-4174-991d-46f31a266b9f] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:43:22.120231 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-68de46a3-58bc-4388-8d60-ad083c7bfc11 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:22.121215 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-68de46a3-58bc-4388-8d60-ad083c7bfc11 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:22.123034 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-68de46a3-58bc-4388-8d60-ad083c7bfc11 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:22.123570 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-68de46a3-58bc-4388-8d60-ad083c7bfc11 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:22.365132 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-68de46a3-58bc-4388-8d60-ad083c7bfc11 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa4a2a39deb4e7ba54032acec14e029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc560e8b75194743bbb46d903b481357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:43:22.373896 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-68de46a3-58bc-4388-8d60-ad083c7bfc11 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "GET /compute/v2.1/servers/69b0d8dd-4d36-4174-991d-46f31a266b9f" status: 200 len: 1366 microversion: 2.1 time: 0.269248 May 19 13:43:22.384386 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 498/980] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:43:22 2022] GET /compute/v2.1/servers/69b0d8dd-4d36-4174-991d-46f31a266b9f => generated 1366 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:43:22.671881 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [req-26270242-88ce-4293-9e6a-047ab1b314ab req-650954d1-6068-44eb-b6ef-d210aed8e904 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69b0d8dd-4d36-4174-991d-46f31a266b9f", "tag": "98264b7d-bc99-4573-9028-d60b0f3ed3be"}]} {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:43:22.686988 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [req-26270242-88ce-4293-9e6a-047ab1b314ab req-650954d1-6068-44eb-b6ef-d210aed8e904 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:22.690774 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [req-26270242-88ce-4293-9e6a-047ab1b314ab req-650954d1-6068-44eb-b6ef-d210aed8e904 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:22.706559 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.compute.server_external_events [req-26270242-88ce-4293-9e6a-047ab1b314ab req-650954d1-6068-44eb-b6ef-d210aed8e904 service nova] Creating event network-changed:98264b7d-bc99-4573-9028-d60b0f3ed3be for instance 69b0d8dd-4d36-4174-991d-46f31a266b9f on hv-cinder-84112 May 19 13:43:22.713188 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [req-26270242-88ce-4293-9e6a-047ab1b314ab req-650954d1-6068-44eb-b6ef-d210aed8e904 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045546 May 19 13:43:22.716734 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 483/981] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:43:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 13:43:23.392403 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-ba9e9a19-c4d5-4f17-a008-27b637f9b058 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:43:23.393685 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-ba9e9a19-c4d5-4f17-a008-27b637f9b058 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: 69b0d8dd-4d36-4174-991d-46f31a266b9f] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:43:23.400848 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-ba9e9a19-c4d5-4f17-a008-27b637f9b058 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:23.401297 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-ba9e9a19-c4d5-4f17-a008-27b637f9b058 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:23.402226 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-ba9e9a19-c4d5-4f17-a008-27b637f9b058 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:23.402687 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-ba9e9a19-c4d5-4f17-a008-27b637f9b058 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:23.610406 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-ba9e9a19-c4d5-4f17-a008-27b637f9b058 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa4a2a39deb4e7ba54032acec14e029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc560e8b75194743bbb46d903b481357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:43:23.618595 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-ba9e9a19-c4d5-4f17-a008-27b637f9b058 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "GET /compute/v2.1/servers/69b0d8dd-4d36-4174-991d-46f31a266b9f" status: 200 len: 1366 microversion: 2.1 time: 0.230322 May 19 13:43:23.628792 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 499/982] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:43:23 2022] GET /compute/v2.1/servers/69b0d8dd-4d36-4174-991d-46f31a266b9f => generated 1366 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:43:24.637148 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-8d2c86bc-f34d-49af-858a-338a33f368dd tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:43:24.638037 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-8d2c86bc-f34d-49af-858a-338a33f368dd tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: 69b0d8dd-4d36-4174-991d-46f31a266b9f] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:43:24.645402 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-8d2c86bc-f34d-49af-858a-338a33f368dd tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:24.646017 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-8d2c86bc-f34d-49af-858a-338a33f368dd tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:24.646930 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-8d2c86bc-f34d-49af-858a-338a33f368dd tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:24.647484 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-8d2c86bc-f34d-49af-858a-338a33f368dd tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:24.801880 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-8d2c86bc-f34d-49af-858a-338a33f368dd tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa4a2a39deb4e7ba54032acec14e029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc560e8b75194743bbb46d903b481357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:43:24.813346 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-8d2c86bc-f34d-49af-858a-338a33f368dd tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "GET /compute/v2.1/servers/69b0d8dd-4d36-4174-991d-46f31a266b9f" status: 200 len: 1366 microversion: 2.1 time: 0.180931 May 19 13:43:24.814859 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 484/983] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:43:24 2022] GET /compute/v2.1/servers/69b0d8dd-4d36-4174-991d-46f31a266b9f => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:43:25.831401 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-60046b45-d63a-49b1-b6cb-645d871ab57a tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:43:25.832470 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-60046b45-d63a-49b1-b6cb-645d871ab57a tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: 69b0d8dd-4d36-4174-991d-46f31a266b9f] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:43:25.839263 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-60046b45-d63a-49b1-b6cb-645d871ab57a tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:25.839715 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-60046b45-d63a-49b1-b6cb-645d871ab57a tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:25.840528 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-60046b45-d63a-49b1-b6cb-645d871ab57a tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:25.840967 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-60046b45-d63a-49b1-b6cb-645d871ab57a tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:25.985875 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-60046b45-d63a-49b1-b6cb-645d871ab57a tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa4a2a39deb4e7ba54032acec14e029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc560e8b75194743bbb46d903b481357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:43:25.995858 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-60046b45-d63a-49b1-b6cb-645d871ab57a tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "GET /compute/v2.1/servers/69b0d8dd-4d36-4174-991d-46f31a266b9f" status: 200 len: 1366 microversion: 2.1 time: 0.168850 May 19 13:43:25.996463 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 500/984] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:43:25 2022] GET /compute/v2.1/servers/69b0d8dd-4d36-4174-991d-46f31a266b9f => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:43:27.016647 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-1581e361-93a1-474a-af23-f0e851216146 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:43:27.017461 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-1581e361-93a1-474a-af23-f0e851216146 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: 69b0d8dd-4d36-4174-991d-46f31a266b9f] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:43:27.022767 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:43:27.029565 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-1581e361-93a1-474a-af23-f0e851216146 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:27.030685 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-1581e361-93a1-474a-af23-f0e851216146 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:27.031466 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-1581e361-93a1-474a-af23-f0e851216146 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:27.031903 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-1581e361-93a1-474a-af23-f0e851216146 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:27.179738 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-1581e361-93a1-474a-af23-f0e851216146 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa4a2a39deb4e7ba54032acec14e029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc560e8b75194743bbb46d903b481357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:43:27.187382 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-1581e361-93a1-474a-af23-f0e851216146 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "GET /compute/v2.1/servers/69b0d8dd-4d36-4174-991d-46f31a266b9f" status: 200 len: 1366 microversion: 2.1 time: 0.177563 May 19 13:43:27.188414 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 485/985] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:43:27 2022] GET /compute/v2.1/servers/69b0d8dd-4d36-4174-991d-46f31a266b9f => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:43:27.268662 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [req-d5b84c50-9fa5-43a9-8ead-cd8c840b8a28 req-47712b81-57c4-4aba-964f-0d2fa37b7a15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69b0d8dd-4d36-4174-991d-46f31a266b9f", "name": "network-vif-plugged", "status": "completed", "tag": "98264b7d-bc99-4573-9028-d60b0f3ed3be"}]} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:43:27.280652 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-d5b84c50-9fa5-43a9-8ead-cd8c840b8a28 req-47712b81-57c4-4aba-964f-0d2fa37b7a15 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:27.281502 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-d5b84c50-9fa5-43a9-8ead-cd8c840b8a28 req-47712b81-57c4-4aba-964f-0d2fa37b7a15 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:27.294161 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.compute.server_external_events [req-d5b84c50-9fa5-43a9-8ead-cd8c840b8a28 req-47712b81-57c4-4aba-964f-0d2fa37b7a15 service nova] Creating event network-vif-plugged:98264b7d-bc99-4573-9028-d60b0f3ed3be for instance 69b0d8dd-4d36-4174-991d-46f31a266b9f on hv-cinder-84112 May 19 13:43:27.300062 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [req-d5b84c50-9fa5-43a9-8ead-cd8c840b8a28 req-47712b81-57c4-4aba-964f-0d2fa37b7a15 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035451 May 19 13:43:27.300671 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 501/986] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:43:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:43:28.205641 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-a860da58-21d5-4a1b-a2c0-c6e634b80c81 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:43:28.206229 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-a860da58-21d5-4a1b-a2c0-c6e634b80c81 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: 69b0d8dd-4d36-4174-991d-46f31a266b9f] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:43:28.212895 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-a860da58-21d5-4a1b-a2c0-c6e634b80c81 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:28.213336 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-a860da58-21d5-4a1b-a2c0-c6e634b80c81 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:28.214153 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-a860da58-21d5-4a1b-a2c0-c6e634b80c81 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:28.214580 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-a860da58-21d5-4a1b-a2c0-c6e634b80c81 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:28.355216 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-a860da58-21d5-4a1b-a2c0-c6e634b80c81 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa4a2a39deb4e7ba54032acec14e029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc560e8b75194743bbb46d903b481357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:43:28.363539 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-a860da58-21d5-4a1b-a2c0-c6e634b80c81 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "GET /compute/v2.1/servers/69b0d8dd-4d36-4174-991d-46f31a266b9f" status: 200 len: 1366 microversion: 2.1 time: 0.161940 May 19 13:43:28.364502 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 486/987] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:43:28 2022] GET /compute/v2.1/servers/69b0d8dd-4d36-4174-991d-46f31a266b9f => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:43:29.381357 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-253ab7ae-659a-4c79-ac94-c19628a1790c tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:43:29.382184 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-253ab7ae-659a-4c79-ac94-c19628a1790c tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: 69b0d8dd-4d36-4174-991d-46f31a266b9f] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:43:29.388584 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-253ab7ae-659a-4c79-ac94-c19628a1790c tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:29.389033 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-253ab7ae-659a-4c79-ac94-c19628a1790c tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:29.389826 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-253ab7ae-659a-4c79-ac94-c19628a1790c tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:29.390281 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-253ab7ae-659a-4c79-ac94-c19628a1790c tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:29.530294 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-253ab7ae-659a-4c79-ac94-c19628a1790c tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa4a2a39deb4e7ba54032acec14e029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc560e8b75194743bbb46d903b481357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:43:29.540948 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-253ab7ae-659a-4c79-ac94-c19628a1790c tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "GET /compute/v2.1/servers/69b0d8dd-4d36-4174-991d-46f31a266b9f" status: 200 len: 1555 microversion: 2.1 time: 0.164015 May 19 13:43:29.541904 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 502/988] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:43:29 2022] GET /compute/v2.1/servers/69b0d8dd-4d36-4174-991d-46f31a266b9f => generated 1555 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:43:29.560071 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-caa7eb76-8269-4683-a351-ff09ee750586 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:43:29.560594 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-caa7eb76-8269-4683-a351-ff09ee750586 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: 69b0d8dd-4d36-4174-991d-46f31a266b9f] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:43:29.567852 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-caa7eb76-8269-4683-a351-ff09ee750586 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:29.568295 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-caa7eb76-8269-4683-a351-ff09ee750586 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:29.569048 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-caa7eb76-8269-4683-a351-ff09ee750586 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:29.569514 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-caa7eb76-8269-4683-a351-ff09ee750586 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:29.652329 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-caa7eb76-8269-4683-a351-ff09ee750586 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "GET /compute/v2.1/servers/69b0d8dd-4d36-4174-991d-46f31a266b9f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096092 May 19 13:43:29.652925 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 487/989] 10.222.0.24 () {58 vars in 1274 bytes} [Thu May 19 13:43:29 2022] GET /compute/v2.1/servers/69b0d8dd-4d36-4174-991d-46f31a266b9f/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:43:31.058088 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [req-c1a504f8-8751-4b7d-902c-2ca1f9396bde req-b1e8b12f-0582-49f8-ab16-ccc07b61351f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69b0d8dd-4d36-4174-991d-46f31a266b9f", "tag": "98264b7d-bc99-4573-9028-d60b0f3ed3be"}]} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:43:31.063087 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_cell0:SELECT=2 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:43:31.070923 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-c1a504f8-8751-4b7d-902c-2ca1f9396bde req-b1e8b12f-0582-49f8-ab16-ccc07b61351f service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:31.071374 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-c1a504f8-8751-4b7d-902c-2ca1f9396bde req-b1e8b12f-0582-49f8-ab16-ccc07b61351f service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:31.086755 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.compute.server_external_events [req-c1a504f8-8751-4b7d-902c-2ca1f9396bde req-b1e8b12f-0582-49f8-ab16-ccc07b61351f service nova] Creating event network-changed:98264b7d-bc99-4573-9028-d60b0f3ed3be for instance 69b0d8dd-4d36-4174-991d-46f31a266b9f on hv-cinder-84112 May 19 13:43:31.094514 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [req-c1a504f8-8751-4b7d-902c-2ca1f9396bde req-b1e8b12f-0582-49f8-ab16-ccc07b61351f service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042338 May 19 13:43:31.096496 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 503/990] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:43:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:43:57.139213 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-785eab86-efe9-4edf-b5d4-c30b9f6280ab tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:43:57.139767 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-785eab86-efe9-4edf-b5d4-c30b9f6280ab tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] [instance: b649c85b-1ed3-454b-8ca3-bb53ebc85d91] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:43:57.141945 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [req-8eaeee4d-7201-405d-8994-190f448a338e req-0ef3af5e-97a4-4fc4-a429-35c7bf9ec0f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b649c85b-1ed3-454b-8ca3-bb53ebc85d91", "tag": "5d430264-4bd6-4eeb-8a94-9063eff662ea"}]} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:43:57.142962 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_cell0:SELECT=2 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:43:57.143922 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_cell0:SELECT=10 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:43:57.145349 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_api:SELECT=4 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:43:57.146429 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=1 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:43:57.146558 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:43:57.147652 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_cell1:SELECT=38 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:43:57.150546 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-785eab86-efe9-4edf-b5d4-c30b9f6280ab tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:57.150993 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-785eab86-efe9-4edf-b5d4-c30b9f6280ab tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:57.151794 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-785eab86-efe9-4edf-b5d4-c30b9f6280ab tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:57.152223 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-785eab86-efe9-4edf-b5d4-c30b9f6280ab tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:57.153370 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-8eaeee4d-7201-405d-8994-190f448a338e req-0ef3af5e-97a4-4fc4-a429-35c7bf9ec0f4 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:57.153833 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-8eaeee4d-7201-405d-8994-190f448a338e req-0ef3af5e-97a4-4fc4-a429-35c7bf9ec0f4 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:57.167255 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.compute.server_external_events [req-8eaeee4d-7201-405d-8994-190f448a338e req-0ef3af5e-97a4-4fc4-a429-35c7bf9ec0f4 service nova] Creating event network-changed:5d430264-4bd6-4eeb-8a94-9063eff662ea for instance b649c85b-1ed3-454b-8ca3-bb53ebc85d91 on hv-cinder-84112 May 19 13:43:57.173013 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [req-8eaeee4d-7201-405d-8994-190f448a338e req-0ef3af5e-97a4-4fc4-a429-35c7bf9ec0f4 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035410 May 19 13:43:57.173967 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 504/991] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:43:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:43:57.180594 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-785eab86-efe9-4edf-b5d4-c30b9f6280ab tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] [instance: b649c85b-1ed3-454b-8ca3-bb53ebc85d91] Going to try to terminate instance {{(pid=120472) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 13:43:57.289991 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-785eab86-efe9-4edf-b5d4-c30b9f6280ab tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] 10.222.0.24 "DELETE /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91" status: 204 len: 0 microversion: 2.1 time: 0.154362 May 19 13:43:57.294600 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 488/992] 10.222.0.24 () {58 vars in 1238 bytes} [Thu May 19 13:43:57 2022] DELETE /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 13:43:57.300824 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-56238cd6-2004-4a65-a7d1-49895335fb8b tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:43:57.301708 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-56238cd6-2004-4a65-a7d1-49895335fb8b tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] [instance: b649c85b-1ed3-454b-8ca3-bb53ebc85d91] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:43:57.309112 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-56238cd6-2004-4a65-a7d1-49895335fb8b tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:57.310762 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-56238cd6-2004-4a65-a7d1-49895335fb8b tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:57.311610 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-56238cd6-2004-4a65-a7d1-49895335fb8b tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:57.312046 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-56238cd6-2004-4a65-a7d1-49895335fb8b tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:57.445692 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-56238cd6-2004-4a65-a7d1-49895335fb8b tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485d40bf82e421bafbb714c60c96df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430899def10d40c192f0d54b8ebf0af5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:43:57.453560 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-56238cd6-2004-4a65-a7d1-49895335fb8b tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] 10.222.0.24 "GET /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91" status: 200 len: 1567 microversion: 2.1 time: 0.157389 May 19 13:43:57.454167 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 505/993] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:43:57 2022] GET /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:43:58.472686 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-72ef901a-c159-49d7-8d8a-8a4c1b780e48 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:43:58.473402 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-72ef901a-c159-49d7-8d8a-8a4c1b780e48 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] [instance: b649c85b-1ed3-454b-8ca3-bb53ebc85d91] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:43:58.480316 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-72ef901a-c159-49d7-8d8a-8a4c1b780e48 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:58.480763 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-72ef901a-c159-49d7-8d8a-8a4c1b780e48 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:58.481564 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-72ef901a-c159-49d7-8d8a-8a4c1b780e48 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:58.482045 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-72ef901a-c159-49d7-8d8a-8a4c1b780e48 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:58.613355 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-72ef901a-c159-49d7-8d8a-8a4c1b780e48 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485d40bf82e421bafbb714c60c96df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430899def10d40c192f0d54b8ebf0af5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:43:58.622311 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-72ef901a-c159-49d7-8d8a-8a4c1b780e48 tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] 10.222.0.24 "GET /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91" status: 200 len: 1567 microversion: 2.1 time: 0.154236 May 19 13:43:58.624667 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 489/994] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:43:58 2022] GET /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:43:59.640831 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-3ed23c93-638e-493d-a958-33d230a97b0d tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:43:59.642108 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-3ed23c93-638e-493d-a958-33d230a97b0d tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] [instance: b649c85b-1ed3-454b-8ca3-bb53ebc85d91] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:43:59.648936 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-3ed23c93-638e-493d-a958-33d230a97b0d tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:59.649383 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-3ed23c93-638e-493d-a958-33d230a97b0d tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:59.650171 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-3ed23c93-638e-493d-a958-33d230a97b0d tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:59.650599 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-3ed23c93-638e-493d-a958-33d230a97b0d tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:59.717822 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-3ed23c93-638e-493d-a958-33d230a97b0d tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485d40bf82e421bafbb714c60c96df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430899def10d40c192f0d54b8ebf0af5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:43:59.727403 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-3ed23c93-638e-493d-a958-33d230a97b0d tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] 10.222.0.24 "GET /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91" status: 200 len: 1381 microversion: 2.1 time: 0.090775 May 19 13:43:59.728224 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 506/995] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:43:59 2022] GET /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91 => generated 1381 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:43:59.729979 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [req-cbd9c6f1-1c92-49c7-a280-6bae66f770e8 req-da287e53-fd48-4353-89ba-d285d1e2306a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b649c85b-1ed3-454b-8ca3-bb53ebc85d91", "name": "network-vif-deleted", "tag": "5d430264-4bd6-4eeb-8a94-9063eff662ea"}]} {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:43:59.740832 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [req-cbd9c6f1-1c92-49c7-a280-6bae66f770e8 req-da287e53-fd48-4353-89ba-d285d1e2306a service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:43:59.741268 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [req-cbd9c6f1-1c92-49c7-a280-6bae66f770e8 req-da287e53-fd48-4353-89ba-d285d1e2306a service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:43:59.753755 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.compute.server_external_events [req-cbd9c6f1-1c92-49c7-a280-6bae66f770e8 req-da287e53-fd48-4353-89ba-d285d1e2306a service nova] Creating event network-vif-deleted:5d430264-4bd6-4eeb-8a94-9063eff662ea for instance b649c85b-1ed3-454b-8ca3-bb53ebc85d91 on hv-cinder-84112 May 19 13:43:59.758760 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [req-cbd9c6f1-1c92-49c7-a280-6bae66f770e8 req-da287e53-fd48-4353-89ba-d285d1e2306a service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032495 May 19 13:43:59.759622 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 490/996] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:43:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:44:00.745062 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-25d782c5-d280-43eb-af90-0d6f1bc0be4f tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:44:00.745704 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-25d782c5-d280-43eb-af90-0d6f1bc0be4f tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] [instance: b649c85b-1ed3-454b-8ca3-bb53ebc85d91] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:44:00.752695 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-25d782c5-d280-43eb-af90-0d6f1bc0be4f tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:44:00.753146 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-25d782c5-d280-43eb-af90-0d6f1bc0be4f tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:44:00.753932 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-25d782c5-d280-43eb-af90-0d6f1bc0be4f tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:44:00.754386 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-25d782c5-d280-43eb-af90-0d6f1bc0be4f tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:44:00.768099 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.wsgi [None req-25d782c5-d280-43eb-af90-0d6f1bc0be4f tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] HTTP exception thrown: Instance b649c85b-1ed3-454b-8ca3-bb53ebc85d91 could not be found. May 19 13:44:00.769824 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-25d782c5-d280-43eb-af90-0d6f1bc0be4f tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Request method failure captured: May 19 13:44:00.769824 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: request: GET /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91 HTTP/1.1 May 19 13:44:00.769824 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Accept: application/json May 19 13:44:00.769824 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Accept-Encoding: identity May 19 13:44:00.769824 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Connection: close May 19 13:44:00.769824 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Content-Length: 0 May 19 13:44:00.769824 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Content-Type: application/json May 19 13:44:00.769824 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Host: 10.222.0.24 May 19 13:44:00.769824 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Openstack-System-Scope: None May 19 13:44:00.769824 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: User-Agent: python-urllib3/1.26.9 May 19 13:44:00.769824 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Auth-Token: gAAAAABihkiciMgOzgGTtvMq7SX00_6scW0zgt-sHrX-tuWer55QAMwXdXDI1VZuiqv5s54i45hkhMy8G8HJtBlWZFCJijPe8GZRWBE5ZDhQyE_N_GOjFfzkmcBMGDdmXtZjVtuXeu6VBOXwnxuJv66uGPU1zdoZo8qTNSgyNFp1lveu929rKgM May 19 13:44:00.769824 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Domain-Id: None May 19 13:44:00.769824 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Domain-Name: None May 19 13:44:00.769824 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Identity-Status: Confirmed May 19 13:44:00.769824 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Is-Admin-Project: True May 19 13:44:00.769824 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Domain-Id: default May 19 13:44:00.769824 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Domain-Name: Default May 19 13:44:00.769824 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Id: 430899def10d40c192f0d54b8ebf0af5 May 19 13:44:00.769824 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Name: tempest-TestShelveInstance-1917737341 May 19 13:44:00.769824 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Role: reader,member May 19 13:44:00.769824 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Roles: reader,member May 19 13:44:00.771416 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/430899def10d40c192f0d54b8ebf0af5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/430899def10d40c192f0d54b8ebf0af5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_430899def10d40c192f0d54b8ebf0af5", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/430899def10d40c192f0d54b8ebf0af5"}]}] May 19 13:44:00.771416 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Tenant: tempest-TestShelveInstance-1917737341 May 19 13:44:00.771416 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Tenant-Id: 430899def10d40c192f0d54b8ebf0af5 May 19 13:44:00.771416 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Tenant-Name: tempest-TestShelveInstance-1917737341 May 19 13:44:00.771416 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User: tempest-TestShelveInstance-1917737341-project May 19 13:44:00.771416 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Domain-Id: default May 19 13:44:00.771416 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Domain-Name: Default May 19 13:44:00.771416 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Id: 9485d40bf82e421bafbb714c60c96df2 May 19 13:44:00.771416 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Name: tempest-TestShelveInstance-1917737341-project May 19 13:44:00.771416 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: method: > May 19 13:44:00.771416 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: exception: Instance b649c85b-1ed3-454b-8ca3-bb53ebc85d91 could not be found. May 19 13:44:00.771416 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: action_args: {'id': 'b649c85b-1ed3-454b-8ca3-bb53ebc85d91'} May 19 13:44:00.772358 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:44:00.772358 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:44:00.772358 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 13:44:00.772358 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 13:44:00.772358 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 13:44:00.772358 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 13:44:00.772358 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 13:44:00.772358 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 13:44:00.772358 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 13:44:00.772358 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 13:44:00.772358 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b649c85b-1ed3-454b-8ca3-bb53ebc85d91 could not be found. May 19 13:44:00.772358 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:44:00.772358 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:44:00.772358 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:44:00.772358 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:44:00.772358 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:44:00.772358 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:44:00.772358 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:44:00.772358 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:44:00.772358 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:44:00.773806 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:44:00.773806 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 13:44:00.773806 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 13:44:00.773806 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 13:44:00.773806 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 13:44:00.773806 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 13:44:00.773806 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 13:44:00.773806 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b649c85b-1ed3-454b-8ca3-bb53ebc85d91 could not be found. May 19 13:44:00.773806 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:44:00.773806 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:44:00.773806 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:44:00.773806 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:44:00.773806 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:44:00.773806 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:44:00.773806 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:44:00.773806 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:44:00.773806 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b649c85b-1ed3-454b-8ca3-bb53ebc85d91 could not be found. May 19 13:44:00.773806 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:44:00.775064 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-25d782c5-d280-43eb-af90-0d6f1bc0be4f tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Returning 404 to user: Instance b649c85b-1ed3-454b-8ca3-bb53ebc85d91 could not be found. {{(pid=120471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:44:00.775064 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-25d782c5-d280-43eb-af90-0d6f1bc0be4f tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] 10.222.0.24 "GET /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91" status: 404 len: 111 microversion: 2.1 time: 0.030239 May 19 13:44:00.775064 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 507/997] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:44:00 2022] GET /compute/v2.1/servers/b649c85b-1ed3-454b-8ca3-bb53ebc85d91 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 13:44:00.952207 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-f6e4b7c2-2edb-489f-8761-796de5a588cf tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] Calling method '.version_select at 0x7f7c2a5ddb80>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:44:00.975457 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-f6e4b7c2-2edb-489f-8761-796de5a588cf tempest-TestShelveInstance-1917737341 tempest-TestShelveInstance-1917737341-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-920606449" status: 202 len: 0 microversion: 2.1 time: 0.027681 May 19 13:44:00.975933 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 491/998] 10.222.0.24 () {58 vars in 1250 bytes} [Thu May 19 13:44:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-920606449 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 13:44:04.929209 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-8b527220-2fa1-40ed-a05a-71f2394839c9 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:44:04.929848 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-8b527220-2fa1-40ed-a05a-71f2394839c9 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: 69b0d8dd-4d36-4174-991d-46f31a266b9f] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:44:04.936577 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-8b527220-2fa1-40ed-a05a-71f2394839c9 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:44:04.937029 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-8b527220-2fa1-40ed-a05a-71f2394839c9 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:44:04.937913 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-8b527220-2fa1-40ed-a05a-71f2394839c9 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:44:04.938352 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-8b527220-2fa1-40ed-a05a-71f2394839c9 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:44:04.961815 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-8b527220-2fa1-40ed-a05a-71f2394839c9 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "GET /compute/v2.1/servers/69b0d8dd-4d36-4174-991d-46f31a266b9f/ips" status: 200 len: 149 microversion: 2.1 time: 0.036584 May 19 13:44:04.968348 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 508/999] 10.222.0.24 () {58 vars in 1247 bytes} [Thu May 19 13:44:04 2022] GET /compute/v2.1/servers/69b0d8dd-4d36-4174-991d-46f31a266b9f/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:44:06.347988 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-d241ec71-dff7-48a6-bae7-020ffb4ee4c5 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8ec8c2a3-81ab-431f-8e40-5e46d611d7a6"}} {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:44:06.349200 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-d241ec71-dff7-48a6-bae7-020ffb4ee4c5 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: 69b0d8dd-4d36-4174-991d-46f31a266b9f] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:44:06.356604 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-d241ec71-dff7-48a6-bae7-020ffb4ee4c5 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:44:06.357302 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-d241ec71-dff7-48a6-bae7-020ffb4ee4c5 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:44:06.358383 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-d241ec71-dff7-48a6-bae7-020ffb4ee4c5 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:44:06.358881 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-d241ec71-dff7-48a6-bae7-020ffb4ee4c5 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:44:06.639093 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-d241ec71-dff7-48a6-bae7-020ffb4ee4c5 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "POST /compute/v2.1/servers/69b0d8dd-4d36-4174-991d-46f31a266b9f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.295168 May 19 13:44:06.639865 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 492/1000] 10.222.0.24 () {60 vars in 1322 bytes} [Thu May 19 13:44:06 2022] POST /compute/v2.1/servers/69b0d8dd-4d36-4174-991d-46f31a266b9f/os-volume_attachments => generated 194 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:44:14.170160 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-5571e942-aea4-4bde-a6c0-a5f9ff887026 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8ec8c2a3-81ab-431f-8e40-5e46d611d7a6"}} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:44:14.171457 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-5571e942-aea4-4bde-a6c0-a5f9ff887026 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: 69b0d8dd-4d36-4174-991d-46f31a266b9f] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:44:14.180174 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-5571e942-aea4-4bde-a6c0-a5f9ff887026 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:44:14.180618 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-5571e942-aea4-4bde-a6c0-a5f9ff887026 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:44:14.181365 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-5571e942-aea4-4bde-a6c0-a5f9ff887026 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:44:14.181820 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-5571e942-aea4-4bde-a6c0-a5f9ff887026 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:44:14.266925 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.wsgi [None req-5571e942-aea4-4bde-a6c0-a5f9ff887026 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] HTTP exception thrown: Invalid volume: volume 8ec8c2a3-81ab-431f-8e40-5e46d611d7a6 is already attached to instances: 69b0d8dd-4d36-4174-991d-46f31a266b9f May 19 13:44:14.268556 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-5571e942-aea4-4bde-a6c0-a5f9ff887026 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Request method failure captured: May 19 13:44:14.268556 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: request: POST /compute/v2.1/servers/69b0d8dd-4d36-4174-991d-46f31a266b9f/os-volume_attachments HTTP/1.1 May 19 13:44:14.268556 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Accept: application/json May 19 13:44:14.268556 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Accept-Encoding: identity May 19 13:44:14.268556 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Connection: close May 19 13:44:14.268556 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Content-Length: 74 May 19 13:44:14.268556 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Content-Type: application/json May 19 13:44:14.268556 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Host: 10.222.0.24 May 19 13:44:14.268556 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Openstack-System-Scope: None May 19 13:44:14.268556 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: User-Agent: python-urllib3/1.26.9 May 19 13:44:14.268556 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Auth-Token: gAAAAABihkj6liBLvukkw2qtst-UG_cKJZiNcCgt6W_kQDYluV0QF-s3L61GELG86yuBU_XP0oEocHGYFB77RCnoJWx_PSe5oCa2SU8RfG2VbbO9_x7MK34OtxqKFCLvWQmkpMAhKbbulm_ByBEFHwsuhM1s6duzmOYoRlcr_Dq0_GCOhJ038Nk May 19 13:44:14.268556 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Domain-Id: None May 19 13:44:14.268556 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Domain-Name: None May 19 13:44:14.268556 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Identity-Status: Confirmed May 19 13:44:14.268556 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Is-Admin-Project: True May 19 13:44:14.268556 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Domain-Id: default May 19 13:44:14.268556 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Domain-Name: Default May 19 13:44:14.268556 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Id: bc560e8b75194743bbb46d903b481357 May 19 13:44:14.268556 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Name: tempest-AttachVolumeNegativeTest-35839424 May 19 13:44:14.268556 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Role: reader,member May 19 13:44:14.268556 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Roles: reader,member May 19 13:44:14.270219 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/bc560e8b75194743bbb46d903b481357"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/bc560e8b75194743bbb46d903b481357"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_bc560e8b75194743bbb46d903b481357", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/bc560e8b75194743bbb46d903b481357"}]}] May 19 13:44:14.270219 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Tenant: tempest-AttachVolumeNegativeTest-35839424 May 19 13:44:14.270219 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Tenant-Id: bc560e8b75194743bbb46d903b481357 May 19 13:44:14.270219 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-35839424 May 19 13:44:14.270219 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User: tempest-AttachVolumeNegativeTest-35839424-project May 19 13:44:14.270219 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Domain-Id: default May 19 13:44:14.270219 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Domain-Name: Default May 19 13:44:14.270219 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Id: daa4a2a39deb4e7ba54032acec14e029 May 19 13:44:14.270219 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Name: tempest-AttachVolumeNegativeTest-35839424-project May 19 13:44:14.270219 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: May 19 13:44:14.270219 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: {"volumeAttachment": {"volumeId": "8ec8c2a3-81ab-431f-8e40-5e46d611d7a6"}} May 19 13:44:14.270219 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: method: > May 19 13:44:14.271052 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: exception: Invalid volume: volume 8ec8c2a3-81ab-431f-8e40-5e46d611d7a6 is already attached to instances: 69b0d8dd-4d36-4174-991d-46f31a266b9f May 19 13:44:14.271052 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: action_args: {'server_id': '69b0d8dd-4d36-4174-991d-46f31a266b9f', 'body': {'volumeAttachment': {'volumeId': '8ec8c2a3-81ab-431f-8e40-5e46d611d7a6'}}} May 19 13:44:14.271052 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:44:14.271052 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:44:14.271052 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 19 13:44:14.271052 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 19 13:44:14.271052 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 19 13:44:14.271052 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 13:44:14.271052 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 19 13:44:14.271052 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 19 13:44:14.271052 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 19 13:44:14.271052 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 19 13:44:14.271052 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 19 13:44:14.271052 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 19 13:44:14.271052 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 8ec8c2a3-81ab-431f-8e40-5e46d611d7a6 is already attached to instances: 69b0d8dd-4d36-4174-991d-46f31a266b9f May 19 13:44:14.271052 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:44:14.271052 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:44:14.271052 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:44:14.271052 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:44:14.272376 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:44:14.272376 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:44:14.272376 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:44:14.272376 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:44:14.272376 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:44:14.272376 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:44:14.272376 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 13:44:14.272376 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 13:44:14.272376 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 13:44:14.272376 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 13:44:14.272376 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 13:44:14.272376 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 13:44:14.272376 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 19 13:44:14.272376 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 19 13:44:14.272376 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 8ec8c2a3-81ab-431f-8e40-5e46d611d7a6 is already attached to instances: 69b0d8dd-4d36-4174-991d-46f31a266b9f May 19 13:44:14.272376 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:44:14.272376 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:44:14.272376 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:44:14.272376 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:44:14.272376 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:44:14.273745 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:44:14.273745 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:44:14.273745 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:44:14.273745 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 8ec8c2a3-81ab-431f-8e40-5e46d611d7a6 is already attached to instances: 69b0d8dd-4d36-4174-991d-46f31a266b9f May 19 13:44:14.273745 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:44:14.273745 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-5571e942-aea4-4bde-a6c0-a5f9ff887026 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Returning 400 to user: Invalid volume: volume 8ec8c2a3-81ab-431f-8e40-5e46d611d7a6 is already attached to instances: 69b0d8dd-4d36-4174-991d-46f31a266b9f {{(pid=120471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:44:14.273745 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-5571e942-aea4-4bde-a6c0-a5f9ff887026 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "POST /compute/v2.1/servers/69b0d8dd-4d36-4174-991d-46f31a266b9f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.107336 May 19 13:44:14.273745 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 509/1001] 10.222.0.24 () {60 vars in 1322 bytes} [Thu May 19 13:44:14 2022] POST /compute/v2.1/servers/69b0d8dd-4d36-4174-991d-46f31a266b9f/os-volume_attachments => generated 174 bytes in 109 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 13:44:14.334427 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-155ba82a-3d23-4394-9856-edabadb64e1b tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:44:14.334968 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-155ba82a-3d23-4394-9856-edabadb64e1b tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: 69b0d8dd-4d36-4174-991d-46f31a266b9f] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:44:14.341825 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-155ba82a-3d23-4394-9856-edabadb64e1b tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:44:14.342260 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-155ba82a-3d23-4394-9856-edabadb64e1b tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:44:14.343014 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-155ba82a-3d23-4394-9856-edabadb64e1b tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:44:14.343433 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-155ba82a-3d23-4394-9856-edabadb64e1b tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:44:14.440442 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.objects.instance [None req-155ba82a-3d23-4394-9856-edabadb64e1b tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lazy-loading 'services' on Instance uuid 69b0d8dd-4d36-4174-991d-46f31a266b9f {{(pid=120472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 13:44:14.523095 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-155ba82a-3d23-4394-9856-edabadb64e1b tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "DELETE /compute/v2.1/servers/69b0d8dd-4d36-4174-991d-46f31a266b9f/os-volume_attachments/8ec8c2a3-81ab-431f-8e40-5e46d611d7a6" status: 202 len: 0 microversion: 2.1 time: 0.193477 May 19 13:44:14.523698 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 493/1002] 10.222.0.24 () {58 vars in 1415 bytes} [Thu May 19 13:44:14 2022] DELETE /compute/v2.1/servers/69b0d8dd-4d36-4174-991d-46f31a266b9f/os-volume_attachments/8ec8c2a3-81ab-431f-8e40-5e46d611d7a6 => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 13:44:14.533348 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-f3fc507e-4fd8-43d0-bc09-1cb6a9a1b3cb tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:44:14.534422 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-f3fc507e-4fd8-43d0-bc09-1cb6a9a1b3cb tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: 69b0d8dd-4d36-4174-991d-46f31a266b9f] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:44:14.542966 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-f3fc507e-4fd8-43d0-bc09-1cb6a9a1b3cb tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:44:14.542966 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-f3fc507e-4fd8-43d0-bc09-1cb6a9a1b3cb tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:44:14.543738 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-f3fc507e-4fd8-43d0-bc09-1cb6a9a1b3cb tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:44:14.544310 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-f3fc507e-4fd8-43d0-bc09-1cb6a9a1b3cb tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:44:14.575498 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-f3fc507e-4fd8-43d0-bc09-1cb6a9a1b3cb tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "GET /compute/v2.1/servers/69b0d8dd-4d36-4174-991d-46f31a266b9f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046231 May 19 13:44:14.576061 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 510/1003] 10.222.0.24 () {58 vars in 1301 bytes} [Thu May 19 13:44:14 2022] GET /compute/v2.1/servers/69b0d8dd-4d36-4174-991d-46f31a266b9f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 13:44:15.589143 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-ed5723cd-8692-431b-be57-1c29ddb9f249 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:44:15.590253 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-ed5723cd-8692-431b-be57-1c29ddb9f249 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: 69b0d8dd-4d36-4174-991d-46f31a266b9f] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:44:15.597825 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-ed5723cd-8692-431b-be57-1c29ddb9f249 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:44:15.598269 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-ed5723cd-8692-431b-be57-1c29ddb9f249 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:44:15.599038 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-ed5723cd-8692-431b-be57-1c29ddb9f249 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:44:15.599466 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-ed5723cd-8692-431b-be57-1c29ddb9f249 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:44:15.629998 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-ed5723cd-8692-431b-be57-1c29ddb9f249 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "GET /compute/v2.1/servers/69b0d8dd-4d36-4174-991d-46f31a266b9f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045770 May 19 13:44:15.630555 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 494/1004] 10.222.0.24 () {58 vars in 1301 bytes} [Thu May 19 13:44:15 2022] GET /compute/v2.1/servers/69b0d8dd-4d36-4174-991d-46f31a266b9f/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 13:44:15.692730 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-17a0ed0f-2569-4dcb-8b38-a7c0ad02bb6b tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:44:15.693238 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-17a0ed0f-2569-4dcb-8b38-a7c0ad02bb6b tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: 69b0d8dd-4d36-4174-991d-46f31a266b9f] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:44:15.700242 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-17a0ed0f-2569-4dcb-8b38-a7c0ad02bb6b tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:44:15.700694 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-17a0ed0f-2569-4dcb-8b38-a7c0ad02bb6b tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:44:15.703139 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-17a0ed0f-2569-4dcb-8b38-a7c0ad02bb6b tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:44:15.703581 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-17a0ed0f-2569-4dcb-8b38-a7c0ad02bb6b tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:44:15.729286 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-17a0ed0f-2569-4dcb-8b38-a7c0ad02bb6b tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: 69b0d8dd-4d36-4174-991d-46f31a266b9f] Going to try to terminate instance {{(pid=120471) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 13:44:15.827402 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-17a0ed0f-2569-4dcb-8b38-a7c0ad02bb6b tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "DELETE /compute/v2.1/servers/69b0d8dd-4d36-4174-991d-46f31a266b9f" status: 204 len: 0 microversion: 2.1 time: 0.137102 May 19 13:44:15.828362 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 511/1005] 10.222.0.24 () {58 vars in 1238 bytes} [Thu May 19 13:44:15 2022] DELETE /compute/v2.1/servers/69b0d8dd-4d36-4174-991d-46f31a266b9f => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 13:44:15.840208 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-5f24f298-6ebc-4fbc-89a7-7fa7e47f48c3 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:44:15.841092 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-5f24f298-6ebc-4fbc-89a7-7fa7e47f48c3 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: 69b0d8dd-4d36-4174-991d-46f31a266b9f] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:44:15.848430 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-5f24f298-6ebc-4fbc-89a7-7fa7e47f48c3 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:44:15.848882 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-5f24f298-6ebc-4fbc-89a7-7fa7e47f48c3 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:44:15.849667 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-5f24f298-6ebc-4fbc-89a7-7fa7e47f48c3 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:44:15.850099 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-5f24f298-6ebc-4fbc-89a7-7fa7e47f48c3 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:44:16.003961 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-5f24f298-6ebc-4fbc-89a7-7fa7e47f48c3 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa4a2a39deb4e7ba54032acec14e029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc560e8b75194743bbb46d903b481357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:44:16.011741 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-5f24f298-6ebc-4fbc-89a7-7fa7e47f48c3 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "GET /compute/v2.1/servers/69b0d8dd-4d36-4174-991d-46f31a266b9f" status: 200 len: 1680 microversion: 2.1 time: 0.177728 May 19 13:44:16.012314 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 495/1006] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:44:15 2022] GET /compute/v2.1/servers/69b0d8dd-4d36-4174-991d-46f31a266b9f => generated 1680 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:44:17.031903 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-8ec0f138-480b-4322-85a7-9cf0cb3411a1 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:44:17.032576 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-8ec0f138-480b-4322-85a7-9cf0cb3411a1 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: 69b0d8dd-4d36-4174-991d-46f31a266b9f] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:44:17.039775 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-8ec0f138-480b-4322-85a7-9cf0cb3411a1 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:44:17.040222 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-8ec0f138-480b-4322-85a7-9cf0cb3411a1 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:44:17.040982 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-8ec0f138-480b-4322-85a7-9cf0cb3411a1 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:44:17.041431 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-8ec0f138-480b-4322-85a7-9cf0cb3411a1 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:44:17.187867 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-8ec0f138-480b-4322-85a7-9cf0cb3411a1 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa4a2a39deb4e7ba54032acec14e029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc560e8b75194743bbb46d903b481357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:44:17.196041 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-8ec0f138-480b-4322-85a7-9cf0cb3411a1 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "GET /compute/v2.1/servers/69b0d8dd-4d36-4174-991d-46f31a266b9f" status: 200 len: 1680 microversion: 2.1 time: 0.169690 May 19 13:44:17.196654 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 512/1007] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:44:17 2022] GET /compute/v2.1/servers/69b0d8dd-4d36-4174-991d-46f31a266b9f => generated 1680 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:44:18.215259 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-58095504-5c78-4858-a657-718bc893d636 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:44:18.218175 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-58095504-5c78-4858-a657-718bc893d636 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: 69b0d8dd-4d36-4174-991d-46f31a266b9f] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:44:18.226596 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-58095504-5c78-4858-a657-718bc893d636 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:44:18.227298 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-58095504-5c78-4858-a657-718bc893d636 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:44:18.228284 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-58095504-5c78-4858-a657-718bc893d636 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:44:18.228905 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-58095504-5c78-4858-a657-718bc893d636 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:44:18.328502 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-58095504-5c78-4858-a657-718bc893d636 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa4a2a39deb4e7ba54032acec14e029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc560e8b75194743bbb46d903b481357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:44:18.330857 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [req-215544f6-ff9f-4a6d-837f-adf8c76af09e req-49ee7b62-6178-488d-86e8-81227ef3363b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69b0d8dd-4d36-4174-991d-46f31a266b9f", "name": "network-vif-deleted", "tag": "98264b7d-bc99-4573-9028-d60b0f3ed3be"}]} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:44:18.343726 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-215544f6-ff9f-4a6d-837f-adf8c76af09e req-49ee7b62-6178-488d-86e8-81227ef3363b service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:44:18.344640 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-215544f6-ff9f-4a6d-837f-adf8c76af09e req-49ee7b62-6178-488d-86e8-81227ef3363b service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:44:18.345040 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-58095504-5c78-4858-a657-718bc893d636 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "GET /compute/v2.1/servers/69b0d8dd-4d36-4174-991d-46f31a266b9f" status: 200 len: 1613 microversion: 2.1 time: 0.133771 May 19 13:44:18.345763 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 496/1008] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:44:18 2022] GET /compute/v2.1/servers/69b0d8dd-4d36-4174-991d-46f31a266b9f => generated 1613 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:44:18.375735 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.compute.server_external_events [req-215544f6-ff9f-4a6d-837f-adf8c76af09e req-49ee7b62-6178-488d-86e8-81227ef3363b service nova] Creating event network-vif-deleted:98264b7d-bc99-4573-9028-d60b0f3ed3be for instance 69b0d8dd-4d36-4174-991d-46f31a266b9f on hv-cinder-84112 May 19 13:44:18.382237 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [req-215544f6-ff9f-4a6d-837f-adf8c76af09e req-49ee7b62-6178-488d-86e8-81227ef3363b service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059669 May 19 13:44:18.383031 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 513/1009] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:44:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:44:19.362876 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-212b0b33-4897-44d4-9d6f-b40f6141a7b5 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:44:19.363460 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-212b0b33-4897-44d4-9d6f-b40f6141a7b5 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: 69b0d8dd-4d36-4174-991d-46f31a266b9f] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:44:19.370576 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-212b0b33-4897-44d4-9d6f-b40f6141a7b5 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:44:19.371017 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-212b0b33-4897-44d4-9d6f-b40f6141a7b5 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:44:19.371767 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-212b0b33-4897-44d4-9d6f-b40f6141a7b5 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:44:19.372191 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-212b0b33-4897-44d4-9d6f-b40f6141a7b5 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:44:19.386004 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.wsgi [None req-212b0b33-4897-44d4-9d6f-b40f6141a7b5 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] HTTP exception thrown: Instance 69b0d8dd-4d36-4174-991d-46f31a266b9f could not be found. May 19 13:44:19.387660 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-212b0b33-4897-44d4-9d6f-b40f6141a7b5 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Request method failure captured: May 19 13:44:19.387660 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: request: GET /compute/v2.1/servers/69b0d8dd-4d36-4174-991d-46f31a266b9f HTTP/1.1 May 19 13:44:19.387660 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Accept: application/json May 19 13:44:19.387660 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Accept-Encoding: identity May 19 13:44:19.387660 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Connection: close May 19 13:44:19.387660 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Content-Length: 0 May 19 13:44:19.387660 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Content-Type: application/json May 19 13:44:19.387660 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Host: 10.222.0.24 May 19 13:44:19.387660 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Openstack-System-Scope: None May 19 13:44:19.387660 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: User-Agent: python-urllib3/1.26.9 May 19 13:44:19.387660 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Auth-Token: gAAAAABihkj6liBLvukkw2qtst-UG_cKJZiNcCgt6W_kQDYluV0QF-s3L61GELG86yuBU_XP0oEocHGYFB77RCnoJWx_PSe5oCa2SU8RfG2VbbO9_x7MK34OtxqKFCLvWQmkpMAhKbbulm_ByBEFHwsuhM1s6duzmOYoRlcr_Dq0_GCOhJ038Nk May 19 13:44:19.387660 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Domain-Id: None May 19 13:44:19.387660 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Domain-Name: None May 19 13:44:19.387660 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Identity-Status: Confirmed May 19 13:44:19.387660 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Is-Admin-Project: True May 19 13:44:19.387660 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Domain-Id: default May 19 13:44:19.387660 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Domain-Name: Default May 19 13:44:19.387660 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Id: bc560e8b75194743bbb46d903b481357 May 19 13:44:19.387660 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Name: tempest-AttachVolumeNegativeTest-35839424 May 19 13:44:19.387660 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Role: reader,member May 19 13:44:19.387660 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Roles: reader,member May 19 13:44:19.389314 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/bc560e8b75194743bbb46d903b481357"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/bc560e8b75194743bbb46d903b481357"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_bc560e8b75194743bbb46d903b481357", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/bc560e8b75194743bbb46d903b481357"}]}] May 19 13:44:19.389314 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant: tempest-AttachVolumeNegativeTest-35839424 May 19 13:44:19.389314 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant-Id: bc560e8b75194743bbb46d903b481357 May 19 13:44:19.389314 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-35839424 May 19 13:44:19.389314 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User: tempest-AttachVolumeNegativeTest-35839424-project May 19 13:44:19.389314 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Domain-Id: default May 19 13:44:19.389314 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Domain-Name: Default May 19 13:44:19.389314 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Id: daa4a2a39deb4e7ba54032acec14e029 May 19 13:44:19.389314 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Name: tempest-AttachVolumeNegativeTest-35839424-project May 19 13:44:19.389314 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: method: > May 19 13:44:19.389314 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: exception: Instance 69b0d8dd-4d36-4174-991d-46f31a266b9f could not be found. May 19 13:44:19.389314 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: action_args: {'id': '69b0d8dd-4d36-4174-991d-46f31a266b9f'} May 19 13:44:19.390279 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:44:19.390279 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:44:19.390279 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 13:44:19.390279 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 13:44:19.390279 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 13:44:19.390279 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 13:44:19.390279 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 13:44:19.390279 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 13:44:19.390279 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 13:44:19.390279 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 13:44:19.390279 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69b0d8dd-4d36-4174-991d-46f31a266b9f could not be found. May 19 13:44:19.390279 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:44:19.390279 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:44:19.390279 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:44:19.390279 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:44:19.390279 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:44:19.390279 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:44:19.390279 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:44:19.390279 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:44:19.390279 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:44:19.391946 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:44:19.391946 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 13:44:19.391946 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 13:44:19.391946 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 13:44:19.391946 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 13:44:19.391946 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 13:44:19.391946 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 13:44:19.391946 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69b0d8dd-4d36-4174-991d-46f31a266b9f could not be found. May 19 13:44:19.391946 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:44:19.391946 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:44:19.391946 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:44:19.391946 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:44:19.391946 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:44:19.391946 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:44:19.391946 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:44:19.391946 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:44:19.391946 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69b0d8dd-4d36-4174-991d-46f31a266b9f could not be found. May 19 13:44:19.391946 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:44:19.393535 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-212b0b33-4897-44d4-9d6f-b40f6141a7b5 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Returning 404 to user: Instance 69b0d8dd-4d36-4174-991d-46f31a266b9f could not be found. {{(pid=120472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:44:19.393535 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-212b0b33-4897-44d4-9d6f-b40f6141a7b5 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "GET /compute/v2.1/servers/69b0d8dd-4d36-4174-991d-46f31a266b9f" status: 404 len: 111 microversion: 2.1 time: 0.030192 May 19 13:44:19.393535 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 497/1010] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:44:19 2022] GET /compute/v2.1/servers/69b0d8dd-4d36-4174-991d-46f31a266b9f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 13:44:19.399249 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-00cc7ad7-7d15-4399-ba9a-60c2da186e62 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Calling method '.version_select at 0x7f7c2a5e0dc0>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:44:19.420260 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-00cc7ad7-7d15-4399-ba9a-60c2da186e62 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1008282767" status: 202 len: 0 microversion: 2.1 time: 0.025549 May 19 13:44:19.420917 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 514/1011] 10.222.0.24 () {58 vars in 1220 bytes} [Thu May 19 13:44:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1008282767 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 13:44:20.058734 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-740092ce-ee54-4dd5-8407-630190dad5a8 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Action: 'create', calling method: .version_select at 0x7f7c2a607ee0>, body: {"keypair": {"name": "tempest-keypair-1994418017", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKnVEnpx+A28oLzTckTaHs81kVz8lTyWr3pcPABweIzJ8ticKxHZUuSXddNv5w+/emFCJdCF67G90PEIt43vXkBh++h+uE0SXA4ulk3bKBq/WgMr04ZTswQqL9Fn3Iel2w=="}} {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:44:20.073588 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.quota [None req-740092ce-ee54-4dd5-8407-630190dad5a8 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Getting quotas for project bc560e8b75194743bbb46d903b481357. Resources: {'key_pairs'} {{(pid=120472) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 13:44:20.077727 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.quota [None req-740092ce-ee54-4dd5-8407-630190dad5a8 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Getting quotas for user daa4a2a39deb4e7ba54032acec14e029 and project bc560e8b75194743bbb46d903b481357. Resources: {'key_pairs'} {{(pid=120472) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 13:44:20.103368 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-740092ce-ee54-4dd5-8407-630190dad5a8 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048695 May 19 13:44:20.103956 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 498/1012] 10.222.0.24 () {60 vars in 1158 bytes} [Thu May 19 13:44:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:44:21.467352 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-6d61b3e3-2f88-4596-915e-2b2dce40e7e2 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-986056805", "imageRef": "9beb860d-9c3f-4244-80aa-71a9c337a429", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "39a38089-655e-4b34-b99f-11a97c39ff7d"}], "security_groups": [{"name": "tempest-securitygroup--1166436278"}], "key_name": "tempest-keypair-1994418017", "user_data": "}} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:44:21.574152 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.network.neutron [None req-6d61b3e3-2f88-4596-915e-2b2dce40e7e2 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] validate_networks() for [('39a38089-655e-4b34-b99f-11a97c39ff7d', None, None, None, None, None)] {{(pid=120471) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 13:44:21.963204 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.virt.hardware [None req-6d61b3e3-2f88-4596-915e-2b2dce40e7e2 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Flavor limits 0:0:0 {{(pid=120471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 13:44:21.963728 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.virt.hardware [None req-6d61b3e3-2f88-4596-915e-2b2dce40e7e2 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Image limits 0:0:0 {{(pid=120471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 13:44:21.964435 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.virt.hardware [None req-6d61b3e3-2f88-4596-915e-2b2dce40e7e2 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Flavor pref 0:0:0 {{(pid=120471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 13:44:21.964975 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.virt.hardware [None req-6d61b3e3-2f88-4596-915e-2b2dce40e7e2 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Image pref 0:0:0 {{(pid=120471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 13:44:21.965803 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.virt.hardware [None req-6d61b3e3-2f88-4596-915e-2b2dce40e7e2 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 13:44:21.979542 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-6d61b3e3-2f88-4596-915e-2b2dce40e7e2 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:44:21.980154 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-6d61b3e3-2f88-4596-915e-2b2dce40e7e2 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:44:21.981312 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-6d61b3e3-2f88-4596-915e-2b2dce40e7e2 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:44:21.982113 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-6d61b3e3-2f88-4596-915e-2b2dce40e7e2 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:44:21.999371 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.quota [None req-6d61b3e3-2f88-4596-915e-2b2dce40e7e2 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Getting quotas for project bc560e8b75194743bbb46d903b481357. Resources: {'instances', 'cores', 'ram'} {{(pid=120471) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 13:44:22.003578 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.quota [None req-6d61b3e3-2f88-4596-915e-2b2dce40e7e2 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Getting quotas for user daa4a2a39deb4e7ba54032acec14e029 and project bc560e8b75194743bbb46d903b481357. Resources: {'instances', 'cores', 'ram'} {{(pid=120471) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 13:44:22.015306 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-6d61b3e3-2f88-4596-915e-2b2dce40e7e2 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Going to run 1 instances... {{(pid=120471) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 13:44:22.017824 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-6d61b3e3-2f88-4596-915e-2b2dce40e7e2 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: 50a5a1ba-fb03-4cb8-8037-1aeee7b99be4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9beb860d-9c3f-4244-80aa-71a9c337a429',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120471) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 13:44:22.068031 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-6d61b3e3-2f88-4596-915e-2b2dce40e7e2 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.605659 May 19 13:44:22.068606 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 515/1013] 10.222.0.24 () {60 vars in 1146 bytes} [Thu May 19 13:44:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 607 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 13:44:22.080206 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-c5d96d68-d97f-4f83-865f-b11f9f067ec7 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:44:22.080841 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-c5d96d68-d97f-4f83-865f-b11f9f067ec7 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: 50a5a1ba-fb03-4cb8-8037-1aeee7b99be4] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:44:22.136385 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-c5d96d68-d97f-4f83-865f-b11f9f067ec7 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa4a2a39deb4e7ba54032acec14e029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc560e8b75194743bbb46d903b481357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:44:22.143523 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-c5d96d68-d97f-4f83-865f-b11f9f067ec7 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "GET /compute/v2.1/servers/50a5a1ba-fb03-4cb8-8037-1aeee7b99be4" status: 200 len: 1241 microversion: 2.1 time: 0.068401 May 19 13:44:22.144170 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 499/1014] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:44:22 2022] GET /compute/v2.1/servers/50a5a1ba-fb03-4cb8-8037-1aeee7b99be4 => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:44:23.161568 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-b49b39c9-eabd-46c7-90f2-c71c6bbc1d23 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:44:23.162894 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-b49b39c9-eabd-46c7-90f2-c71c6bbc1d23 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: 50a5a1ba-fb03-4cb8-8037-1aeee7b99be4] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:44:23.169932 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-b49b39c9-eabd-46c7-90f2-c71c6bbc1d23 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:44:23.170382 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-b49b39c9-eabd-46c7-90f2-c71c6bbc1d23 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:44:23.171149 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-b49b39c9-eabd-46c7-90f2-c71c6bbc1d23 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:44:23.171573 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-b49b39c9-eabd-46c7-90f2-c71c6bbc1d23 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:44:23.242697 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-b49b39c9-eabd-46c7-90f2-c71c6bbc1d23 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa4a2a39deb4e7ba54032acec14e029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc560e8b75194743bbb46d903b481357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:44:23.253549 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-b49b39c9-eabd-46c7-90f2-c71c6bbc1d23 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "GET /compute/v2.1/servers/50a5a1ba-fb03-4cb8-8037-1aeee7b99be4" status: 200 len: 1311 microversion: 2.1 time: 0.096603 May 19 13:44:23.254448 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 516/1015] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:44:23 2022] GET /compute/v2.1/servers/50a5a1ba-fb03-4cb8-8037-1aeee7b99be4 => generated 1311 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:44:24.270687 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-d863067c-436c-4f4d-8db1-fb9e029863d1 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:44:24.271294 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-d863067c-436c-4f4d-8db1-fb9e029863d1 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: 50a5a1ba-fb03-4cb8-8037-1aeee7b99be4] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:44:24.278040 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-d863067c-436c-4f4d-8db1-fb9e029863d1 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:44:24.278489 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-d863067c-436c-4f4d-8db1-fb9e029863d1 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:44:24.279248 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-d863067c-436c-4f4d-8db1-fb9e029863d1 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:44:24.279781 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-d863067c-436c-4f4d-8db1-fb9e029863d1 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:44:24.502033 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-d863067c-436c-4f4d-8db1-fb9e029863d1 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa4a2a39deb4e7ba54032acec14e029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc560e8b75194743bbb46d903b481357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:44:24.511594 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-d863067c-436c-4f4d-8db1-fb9e029863d1 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "GET /compute/v2.1/servers/50a5a1ba-fb03-4cb8-8037-1aeee7b99be4" status: 200 len: 1367 microversion: 2.1 time: 0.244735 May 19 13:44:24.512445 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 500/1016] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:44:24 2022] GET /compute/v2.1/servers/50a5a1ba-fb03-4cb8-8037-1aeee7b99be4 => generated 1367 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:44:24.713619 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [req-a84a9346-0f16-4270-9594-c998d57b3d9a req-e776c9d4-ed03-41fa-8465-1460b8ddc964 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50a5a1ba-fb03-4cb8-8037-1aeee7b99be4", "tag": "a712f409-df20-4bde-a594-7e288605b2ae"}]} {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:44:24.723722 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-a84a9346-0f16-4270-9594-c998d57b3d9a req-e776c9d4-ed03-41fa-8465-1460b8ddc964 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:44:24.724514 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [req-a84a9346-0f16-4270-9594-c998d57b3d9a req-e776c9d4-ed03-41fa-8465-1460b8ddc964 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:44:24.743326 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.compute.server_external_events [req-a84a9346-0f16-4270-9594-c998d57b3d9a req-e776c9d4-ed03-41fa-8465-1460b8ddc964 service nova] Creating event network-changed:a712f409-df20-4bde-a594-7e288605b2ae for instance 50a5a1ba-fb03-4cb8-8037-1aeee7b99be4 on hv-cinder-84112 May 19 13:44:24.749095 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [req-a84a9346-0f16-4270-9594-c998d57b3d9a req-e776c9d4-ed03-41fa-8465-1460b8ddc964 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039208 May 19 13:44:24.749959 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 517/1017] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:44:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:44:25.533192 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-216e7c07-c7fa-4b66-a4f8-13f96fefa57d tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:44:25.533936 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-216e7c07-c7fa-4b66-a4f8-13f96fefa57d tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: 50a5a1ba-fb03-4cb8-8037-1aeee7b99be4] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:44:25.542893 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-216e7c07-c7fa-4b66-a4f8-13f96fefa57d tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:44:25.543456 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-216e7c07-c7fa-4b66-a4f8-13f96fefa57d tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:44:25.544414 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-216e7c07-c7fa-4b66-a4f8-13f96fefa57d tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:44:25.544955 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-216e7c07-c7fa-4b66-a4f8-13f96fefa57d tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:44:25.695270 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-216e7c07-c7fa-4b66-a4f8-13f96fefa57d tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa4a2a39deb4e7ba54032acec14e029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc560e8b75194743bbb46d903b481357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:44:25.704116 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-216e7c07-c7fa-4b66-a4f8-13f96fefa57d tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "GET /compute/v2.1/servers/50a5a1ba-fb03-4cb8-8037-1aeee7b99be4" status: 200 len: 1367 microversion: 2.1 time: 0.176250 May 19 13:44:25.704690 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 501/1018] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:44:25 2022] GET /compute/v2.1/servers/50a5a1ba-fb03-4cb8-8037-1aeee7b99be4 => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:44:26.727430 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-0fa3f52e-5249-4724-8813-40067a01c1d4 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:44:26.728192 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-0fa3f52e-5249-4724-8813-40067a01c1d4 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: 50a5a1ba-fb03-4cb8-8037-1aeee7b99be4] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:44:26.735562 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-0fa3f52e-5249-4724-8813-40067a01c1d4 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:44:26.736312 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-0fa3f52e-5249-4724-8813-40067a01c1d4 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:44:26.737093 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-0fa3f52e-5249-4724-8813-40067a01c1d4 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:44:26.737566 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-0fa3f52e-5249-4724-8813-40067a01c1d4 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:44:26.881492 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-0fa3f52e-5249-4724-8813-40067a01c1d4 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa4a2a39deb4e7ba54032acec14e029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc560e8b75194743bbb46d903b481357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:44:26.896282 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-0fa3f52e-5249-4724-8813-40067a01c1d4 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "GET /compute/v2.1/servers/50a5a1ba-fb03-4cb8-8037-1aeee7b99be4" status: 200 len: 1367 microversion: 2.1 time: 0.173261 May 19 13:44:26.897112 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 518/1019] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:44:26 2022] GET /compute/v2.1/servers/50a5a1ba-fb03-4cb8-8037-1aeee7b99be4 => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:44:27.916763 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-cc4fa295-3547-4e24-91c4-8459d5c439f5 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:44:27.917820 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-cc4fa295-3547-4e24-91c4-8459d5c439f5 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: 50a5a1ba-fb03-4cb8-8037-1aeee7b99be4] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:44:27.920496 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:44:27.926158 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-cc4fa295-3547-4e24-91c4-8459d5c439f5 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:44:27.926608 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-cc4fa295-3547-4e24-91c4-8459d5c439f5 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:44:27.927372 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-cc4fa295-3547-4e24-91c4-8459d5c439f5 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:44:27.927830 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-cc4fa295-3547-4e24-91c4-8459d5c439f5 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:44:27.931249 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:44:28.069983 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-cc4fa295-3547-4e24-91c4-8459d5c439f5 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa4a2a39deb4e7ba54032acec14e029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc560e8b75194743bbb46d903b481357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:44:28.078080 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-cc4fa295-3547-4e24-91c4-8459d5c439f5 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "GET /compute/v2.1/servers/50a5a1ba-fb03-4cb8-8037-1aeee7b99be4" status: 200 len: 1367 microversion: 2.1 time: 0.165765 May 19 13:44:28.078689 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 502/1020] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:44:27 2022] GET /compute/v2.1/servers/50a5a1ba-fb03-4cb8-8037-1aeee7b99be4 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:44:29.097155 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-94647f7c-4c0e-4d32-9323-3201fbd46ecb tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:44:29.097779 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-94647f7c-4c0e-4d32-9323-3201fbd46ecb tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: 50a5a1ba-fb03-4cb8-8037-1aeee7b99be4] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:44:29.100708 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:44:29.107703 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-94647f7c-4c0e-4d32-9323-3201fbd46ecb tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:44:29.108566 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-94647f7c-4c0e-4d32-9323-3201fbd46ecb tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:44:29.109490 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-94647f7c-4c0e-4d32-9323-3201fbd46ecb tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:44:29.110025 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-94647f7c-4c0e-4d32-9323-3201fbd46ecb tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:44:29.114721 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:44:29.253455 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-94647f7c-4c0e-4d32-9323-3201fbd46ecb tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa4a2a39deb4e7ba54032acec14e029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc560e8b75194743bbb46d903b481357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:44:29.261772 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-94647f7c-4c0e-4d32-9323-3201fbd46ecb tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "GET /compute/v2.1/servers/50a5a1ba-fb03-4cb8-8037-1aeee7b99be4" status: 200 len: 1367 microversion: 2.1 time: 0.169759 May 19 13:44:29.262028 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 519/1021] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:44:29 2022] GET /compute/v2.1/servers/50a5a1ba-fb03-4cb8-8037-1aeee7b99be4 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:44:29.661718 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [req-b39f9f09-c7c6-4424-a943-f4d10aca34bf req-af3e75d3-0264-4d0a-936e-b2900992434c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50a5a1ba-fb03-4cb8-8037-1aeee7b99be4", "name": "network-vif-plugged", "status": "completed", "tag": "a712f409-df20-4bde-a594-7e288605b2ae"}]} {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:44:29.671562 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [req-b39f9f09-c7c6-4424-a943-f4d10aca34bf req-af3e75d3-0264-4d0a-936e-b2900992434c service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:44:29.672001 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [req-b39f9f09-c7c6-4424-a943-f4d10aca34bf req-af3e75d3-0264-4d0a-936e-b2900992434c service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:44:29.683202 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.compute.server_external_events [req-b39f9f09-c7c6-4424-a943-f4d10aca34bf req-af3e75d3-0264-4d0a-936e-b2900992434c service nova] Creating event network-vif-plugged:a712f409-df20-4bde-a594-7e288605b2ae for instance 50a5a1ba-fb03-4cb8-8037-1aeee7b99be4 on hv-cinder-84112 May 19 13:44:29.688322 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [req-b39f9f09-c7c6-4424-a943-f4d10aca34bf req-af3e75d3-0264-4d0a-936e-b2900992434c service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030636 May 19 13:44:29.688918 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 503/1022] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:44:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:44:30.279176 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-1c02e935-b69b-4388-a7c8-e5a8492e2e26 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:44:30.279791 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-1c02e935-b69b-4388-a7c8-e5a8492e2e26 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: 50a5a1ba-fb03-4cb8-8037-1aeee7b99be4] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:44:30.286747 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-1c02e935-b69b-4388-a7c8-e5a8492e2e26 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:44:30.287189 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-1c02e935-b69b-4388-a7c8-e5a8492e2e26 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:44:30.287944 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-1c02e935-b69b-4388-a7c8-e5a8492e2e26 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:44:30.288376 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-1c02e935-b69b-4388-a7c8-e5a8492e2e26 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:44:30.431979 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-1c02e935-b69b-4388-a7c8-e5a8492e2e26 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa4a2a39deb4e7ba54032acec14e029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc560e8b75194743bbb46d903b481357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:44:30.441829 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-1c02e935-b69b-4388-a7c8-e5a8492e2e26 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "GET /compute/v2.1/servers/50a5a1ba-fb03-4cb8-8037-1aeee7b99be4" status: 200 len: 1367 microversion: 2.1 time: 0.166292 May 19 13:44:30.442615 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 520/1023] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:44:30 2022] GET /compute/v2.1/servers/50a5a1ba-fb03-4cb8-8037-1aeee7b99be4 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:44:31.462726 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-ea58398a-e48b-46e1-9f92-de3a230fd07f tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:44:31.463629 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-ea58398a-e48b-46e1-9f92-de3a230fd07f tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: 50a5a1ba-fb03-4cb8-8037-1aeee7b99be4] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:44:31.471687 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-ea58398a-e48b-46e1-9f92-de3a230fd07f tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:44:31.472244 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-ea58398a-e48b-46e1-9f92-de3a230fd07f tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:44:31.473181 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-ea58398a-e48b-46e1-9f92-de3a230fd07f tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:44:31.473755 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-ea58398a-e48b-46e1-9f92-de3a230fd07f tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:44:31.611851 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-ea58398a-e48b-46e1-9f92-de3a230fd07f tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa4a2a39deb4e7ba54032acec14e029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc560e8b75194743bbb46d903b481357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:44:31.619518 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-ea58398a-e48b-46e1-9f92-de3a230fd07f tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "GET /compute/v2.1/servers/50a5a1ba-fb03-4cb8-8037-1aeee7b99be4" status: 200 len: 1556 microversion: 2.1 time: 0.162854 May 19 13:44:31.620112 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 504/1024] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:44:31 2022] GET /compute/v2.1/servers/50a5a1ba-fb03-4cb8-8037-1aeee7b99be4 => generated 1556 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:44:31.636146 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-74885bba-2f43-4853-85cf-d86012b6eeb6 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:44:31.636707 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-74885bba-2f43-4853-85cf-d86012b6eeb6 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: 50a5a1ba-fb03-4cb8-8037-1aeee7b99be4] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:44:31.643626 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-74885bba-2f43-4853-85cf-d86012b6eeb6 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:44:31.644068 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-74885bba-2f43-4853-85cf-d86012b6eeb6 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:44:31.644885 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-74885bba-2f43-4853-85cf-d86012b6eeb6 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:44:31.645314 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-74885bba-2f43-4853-85cf-d86012b6eeb6 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:44:31.739320 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-74885bba-2f43-4853-85cf-d86012b6eeb6 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "GET /compute/v2.1/servers/50a5a1ba-fb03-4cb8-8037-1aeee7b99be4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.106922 May 19 13:44:31.740128 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 521/1025] 10.222.0.24 () {58 vars in 1274 bytes} [Thu May 19 13:44:31 2022] GET /compute/v2.1/servers/50a5a1ba-fb03-4cb8-8037-1aeee7b99be4/os-interface => generated 284 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:44:32.696314 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [req-a40ac577-fead-4978-b87b-c8ce9130304e req-913e0ae2-08b3-4b26-930a-56c9f675c775 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50a5a1ba-fb03-4cb8-8037-1aeee7b99be4", "tag": "a712f409-df20-4bde-a594-7e288605b2ae"}]} {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:44:32.699975 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_cell0:SELECT=6 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:44:32.707059 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [req-a40ac577-fead-4978-b87b-c8ce9130304e req-913e0ae2-08b3-4b26-930a-56c9f675c775 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:44:32.707606 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [req-a40ac577-fead-4978-b87b-c8ce9130304e req-913e0ae2-08b3-4b26-930a-56c9f675c775 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:44:32.719772 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.compute.server_external_events [req-a40ac577-fead-4978-b87b-c8ce9130304e req-913e0ae2-08b3-4b26-930a-56c9f675c775 service nova] Creating event network-changed:a712f409-df20-4bde-a594-7e288605b2ae for instance 50a5a1ba-fb03-4cb8-8037-1aeee7b99be4 on hv-cinder-84112 May 19 13:44:32.725651 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [req-a40ac577-fead-4978-b87b-c8ce9130304e req-913e0ae2-08b3-4b26-930a-56c9f675c775 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032828 May 19 13:44:32.726268 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 505/1026] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:44:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:45:08.990001 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_cell0:SELECT=2 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:45:08.990873 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_cell0:SELECT=6 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:45:08.992114 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_api:SELECT=5 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:45:08.992730 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG dbcounter [-] [120471] Writing DB stats nova_cell1:SELECT=15 {{(pid=120471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:45:08.997154 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-72b9f88d-e22c-431b-bf49-fe077f6c800a tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:45:08.997671 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-72b9f88d-e22c-431b-bf49-fe077f6c800a tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: 50a5a1ba-fb03-4cb8-8037-1aeee7b99be4] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:45:09.005378 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-72b9f88d-e22c-431b-bf49-fe077f6c800a tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:45:09.005899 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-72b9f88d-e22c-431b-bf49-fe077f6c800a tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:45:09.006658 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-72b9f88d-e22c-431b-bf49-fe077f6c800a tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:45:09.007131 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-72b9f88d-e22c-431b-bf49-fe077f6c800a tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:45:09.031021 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-72b9f88d-e22c-431b-bf49-fe077f6c800a tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "GET /compute/v2.1/servers/50a5a1ba-fb03-4cb8-8037-1aeee7b99be4/ips" status: 200 len: 148 microversion: 2.1 time: 0.041754 May 19 13:45:09.031590 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 522/1027] 10.222.0.24 () {58 vars in 1247 bytes} [Thu May 19 13:45:08 2022] GET /compute/v2.1/servers/50a5a1ba-fb03-4cb8-8037-1aeee7b99be4/ips => generated 148 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:45:10.360495 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-ba3fbb6a-122b-4d16-8abb-09ef6077f586 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fb1220b9-4e1c-4cfd-8d39-03fea0de76c2"}} {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:45:10.361725 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-ba3fbb6a-122b-4d16-8abb-09ef6077f586 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: 50a5a1ba-fb03-4cb8-8037-1aeee7b99be4] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:45:10.363983 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_api:SELECT=7 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:45:10.364687 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG dbcounter [-] [120472] Writing DB stats nova_cell1:SELECT=15 {{(pid=120472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:45:10.371681 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-ba3fbb6a-122b-4d16-8abb-09ef6077f586 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:45:10.372143 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-ba3fbb6a-122b-4d16-8abb-09ef6077f586 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:45:10.372911 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-ba3fbb6a-122b-4d16-8abb-09ef6077f586 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:45:10.373326 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-ba3fbb6a-122b-4d16-8abb-09ef6077f586 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:45:10.666925 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-ba3fbb6a-122b-4d16-8abb-09ef6077f586 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "POST /compute/v2.1/servers/50a5a1ba-fb03-4cb8-8037-1aeee7b99be4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.310488 May 19 13:45:10.668146 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 506/1028] 10.222.0.24 () {60 vars in 1322 bytes} [Thu May 19 13:45:10 2022] POST /compute/v2.1/servers/50a5a1ba-fb03-4cb8-8037-1aeee7b99be4/os-volume_attachments => generated 194 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:45:17.268534 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-632bd3fc-6113-4deb-9074-6b057e4955cf tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:45:17.269096 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-632bd3fc-6113-4deb-9074-6b057e4955cf tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: 50a5a1ba-fb03-4cb8-8037-1aeee7b99be4] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:45:17.275552 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-632bd3fc-6113-4deb-9074-6b057e4955cf tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:45:17.275989 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-632bd3fc-6113-4deb-9074-6b057e4955cf tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:45:17.276727 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-632bd3fc-6113-4deb-9074-6b057e4955cf tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:45:17.277152 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-632bd3fc-6113-4deb-9074-6b057e4955cf tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:45:17.362566 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.objects.instance [None req-632bd3fc-6113-4deb-9074-6b057e4955cf tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lazy-loading 'services' on Instance uuid 50a5a1ba-fb03-4cb8-8037-1aeee7b99be4 {{(pid=120471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 13:45:17.441217 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-632bd3fc-6113-4deb-9074-6b057e4955cf tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "DELETE /compute/v2.1/servers/50a5a1ba-fb03-4cb8-8037-1aeee7b99be4/os-volume_attachments/fb1220b9-4e1c-4cfd-8d39-03fea0de76c2" status: 202 len: 0 microversion: 2.1 time: 0.176599 May 19 13:45:17.441828 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 523/1029] 10.222.0.24 () {58 vars in 1415 bytes} [Thu May 19 13:45:17 2022] DELETE /compute/v2.1/servers/50a5a1ba-fb03-4cb8-8037-1aeee7b99be4/os-volume_attachments/fb1220b9-4e1c-4cfd-8d39-03fea0de76c2 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 13:45:17.451335 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-a09fb877-f4e8-45d8-8227-6fb800a1bb99 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:45:17.452402 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-a09fb877-f4e8-45d8-8227-6fb800a1bb99 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: 50a5a1ba-fb03-4cb8-8037-1aeee7b99be4] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:45:17.458789 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-a09fb877-f4e8-45d8-8227-6fb800a1bb99 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:45:17.459245 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-a09fb877-f4e8-45d8-8227-6fb800a1bb99 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:45:17.460003 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-a09fb877-f4e8-45d8-8227-6fb800a1bb99 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:45:17.460432 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-a09fb877-f4e8-45d8-8227-6fb800a1bb99 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:45:17.489991 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-a09fb877-f4e8-45d8-8227-6fb800a1bb99 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "GET /compute/v2.1/servers/50a5a1ba-fb03-4cb8-8037-1aeee7b99be4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043412 May 19 13:45:17.490582 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 507/1030] 10.222.0.24 () {58 vars in 1301 bytes} [Thu May 19 13:45:17 2022] GET /compute/v2.1/servers/50a5a1ba-fb03-4cb8-8037-1aeee7b99be4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:45:18.507149 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-70a5302e-402b-471b-8ea9-29898ee08733 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:45:18.508824 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-70a5302e-402b-471b-8ea9-29898ee08733 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: 50a5a1ba-fb03-4cb8-8037-1aeee7b99be4] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:45:18.516712 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-70a5302e-402b-471b-8ea9-29898ee08733 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:45:18.517158 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-70a5302e-402b-471b-8ea9-29898ee08733 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:45:18.517979 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-70a5302e-402b-471b-8ea9-29898ee08733 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:45:18.518415 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-70a5302e-402b-471b-8ea9-29898ee08733 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:45:18.549859 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-70a5302e-402b-471b-8ea9-29898ee08733 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "GET /compute/v2.1/servers/50a5a1ba-fb03-4cb8-8037-1aeee7b99be4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049977 May 19 13:45:18.550441 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 524/1031] 10.222.0.24 () {58 vars in 1301 bytes} [Thu May 19 13:45:18 2022] GET /compute/v2.1/servers/50a5a1ba-fb03-4cb8-8037-1aeee7b99be4/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 13:45:18.613714 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-564be7cb-5cce-4bf3-801e-2f65b29aee29 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:45:18.614241 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-564be7cb-5cce-4bf3-801e-2f65b29aee29 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: 50a5a1ba-fb03-4cb8-8037-1aeee7b99be4] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:45:18.621015 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-564be7cb-5cce-4bf3-801e-2f65b29aee29 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:45:18.621456 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-564be7cb-5cce-4bf3-801e-2f65b29aee29 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:45:18.622255 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-564be7cb-5cce-4bf3-801e-2f65b29aee29 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:45:18.622691 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-564be7cb-5cce-4bf3-801e-2f65b29aee29 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:45:18.649613 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-564be7cb-5cce-4bf3-801e-2f65b29aee29 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: 50a5a1ba-fb03-4cb8-8037-1aeee7b99be4] Going to try to terminate instance {{(pid=120472) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 13:45:18.733790 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-564be7cb-5cce-4bf3-801e-2f65b29aee29 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "DELETE /compute/v2.1/servers/50a5a1ba-fb03-4cb8-8037-1aeee7b99be4" status: 204 len: 0 microversion: 2.1 time: 0.123507 May 19 13:45:18.734525 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 508/1032] 10.222.0.24 () {58 vars in 1238 bytes} [Thu May 19 13:45:18 2022] DELETE /compute/v2.1/servers/50a5a1ba-fb03-4cb8-8037-1aeee7b99be4 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 13:45:18.746276 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-8f937e29-e41a-42d0-8a57-c0d79d5711dc tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:45:18.746892 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-8f937e29-e41a-42d0-8a57-c0d79d5711dc tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: 50a5a1ba-fb03-4cb8-8037-1aeee7b99be4] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:45:18.753112 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-8f937e29-e41a-42d0-8a57-c0d79d5711dc tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:45:18.753572 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-8f937e29-e41a-42d0-8a57-c0d79d5711dc tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:45:18.754349 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-8f937e29-e41a-42d0-8a57-c0d79d5711dc tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:45:18.754779 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-8f937e29-e41a-42d0-8a57-c0d79d5711dc tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:45:18.897323 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-8f937e29-e41a-42d0-8a57-c0d79d5711dc tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa4a2a39deb4e7ba54032acec14e029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc560e8b75194743bbb46d903b481357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:45:18.906135 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-8f937e29-e41a-42d0-8a57-c0d79d5711dc tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "GET /compute/v2.1/servers/50a5a1ba-fb03-4cb8-8037-1aeee7b99be4" status: 200 len: 1680 microversion: 2.1 time: 0.165464 May 19 13:45:18.906715 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 525/1033] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:45:18 2022] GET /compute/v2.1/servers/50a5a1ba-fb03-4cb8-8037-1aeee7b99be4 => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:45:19.936018 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-258325d0-0be3-4a38-b12e-8f7054e2c35b tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:45:19.937186 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-258325d0-0be3-4a38-b12e-8f7054e2c35b tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: 50a5a1ba-fb03-4cb8-8037-1aeee7b99be4] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:45:19.948282 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-258325d0-0be3-4a38-b12e-8f7054e2c35b tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:45:19.948730 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-258325d0-0be3-4a38-b12e-8f7054e2c35b tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:45:19.949523 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-258325d0-0be3-4a38-b12e-8f7054e2c35b tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:45:19.949957 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-258325d0-0be3-4a38-b12e-8f7054e2c35b tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:45:20.095557 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.policy [None req-258325d0-0be3-4a38-b12e-8f7054e2c35b tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa4a2a39deb4e7ba54032acec14e029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc560e8b75194743bbb46d903b481357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120472) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:45:20.103227 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-258325d0-0be3-4a38-b12e-8f7054e2c35b tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "GET /compute/v2.1/servers/50a5a1ba-fb03-4cb8-8037-1aeee7b99be4" status: 200 len: 1680 microversion: 2.1 time: 0.174831 May 19 13:45:20.103802 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 509/1034] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:45:19 2022] GET /compute/v2.1/servers/50a5a1ba-fb03-4cb8-8037-1aeee7b99be4 => generated 1680 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:45:21.120808 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-75a7b884-1ebf-477d-b626-9ce2353c2a55 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:45:21.121396 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-75a7b884-1ebf-477d-b626-9ce2353c2a55 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: 50a5a1ba-fb03-4cb8-8037-1aeee7b99be4] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:45:21.128507 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-75a7b884-1ebf-477d-b626-9ce2353c2a55 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:45:21.128975 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-75a7b884-1ebf-477d-b626-9ce2353c2a55 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:45:21.129762 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-75a7b884-1ebf-477d-b626-9ce2353c2a55 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:45:21.130193 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-75a7b884-1ebf-477d-b626-9ce2353c2a55 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:45:21.194794 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.policy [None req-75a7b884-1ebf-477d-b626-9ce2353c2a55 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa4a2a39deb4e7ba54032acec14e029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc560e8b75194743bbb46d903b481357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120471) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:45:21.203446 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-75a7b884-1ebf-477d-b626-9ce2353c2a55 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "GET /compute/v2.1/servers/50a5a1ba-fb03-4cb8-8037-1aeee7b99be4" status: 200 len: 1612 microversion: 2.1 time: 0.086861 May 19 13:45:21.204042 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 526/1035] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:45:21 2022] GET /compute/v2.1/servers/50a5a1ba-fb03-4cb8-8037-1aeee7b99be4 => generated 1612 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:45:21.269942 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [req-bc67c5b2-cebc-4433-a938-daa744f9175c req-8c29cfcd-5d5b-487a-a04d-8d6e39c46b12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50a5a1ba-fb03-4cb8-8037-1aeee7b99be4", "name": "network-vif-deleted", "tag": "a712f409-df20-4bde-a594-7e288605b2ae"}]} {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:45:21.279156 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [req-bc67c5b2-cebc-4433-a938-daa744f9175c req-8c29cfcd-5d5b-487a-a04d-8d6e39c46b12 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:45:21.279596 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [req-bc67c5b2-cebc-4433-a938-daa744f9175c req-8c29cfcd-5d5b-487a-a04d-8d6e39c46b12 service nova] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:45:21.291872 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.compute.server_external_events [req-bc67c5b2-cebc-4433-a938-daa744f9175c req-8c29cfcd-5d5b-487a-a04d-8d6e39c46b12 service nova] Creating event network-vif-deleted:a712f409-df20-4bde-a594-7e288605b2ae for instance 50a5a1ba-fb03-4cb8-8037-1aeee7b99be4 on hv-cinder-84112 May 19 13:45:21.299917 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [req-bc67c5b2-cebc-4433-a938-daa744f9175c req-8c29cfcd-5d5b-487a-a04d-8d6e39c46b12 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033939 May 19 13:45:21.300700 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 510/1036] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 13:45:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:45:22.221736 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-a60708c6-8a71-4417-a7e7-233258fe318c tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:45:22.222298 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-a60708c6-8a71-4417-a7e7-233258fe318c tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: 50a5a1ba-fb03-4cb8-8037-1aeee7b99be4] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:45:22.229382 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-a60708c6-8a71-4417-a7e7-233258fe318c tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:45:22.229930 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-a60708c6-8a71-4417-a7e7-233258fe318c tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:45:22.230847 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-a60708c6-8a71-4417-a7e7-233258fe318c tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:45:22.231348 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-a60708c6-8a71-4417-a7e7-233258fe318c tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:45:22.247698 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.wsgi [None req-a60708c6-8a71-4417-a7e7-233258fe318c tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] HTTP exception thrown: Instance 50a5a1ba-fb03-4cb8-8037-1aeee7b99be4 could not be found. May 19 13:45:22.249835 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-a60708c6-8a71-4417-a7e7-233258fe318c tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Request method failure captured: May 19 13:45:22.249835 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: request: GET /compute/v2.1/servers/50a5a1ba-fb03-4cb8-8037-1aeee7b99be4 HTTP/1.1 May 19 13:45:22.249835 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Accept: application/json May 19 13:45:22.249835 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Accept-Encoding: identity May 19 13:45:22.249835 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Connection: close May 19 13:45:22.249835 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Content-Length: 0 May 19 13:45:22.249835 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Content-Type: application/json May 19 13:45:22.249835 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Host: 10.222.0.24 May 19 13:45:22.249835 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Openstack-System-Scope: None May 19 13:45:22.249835 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: User-Agent: python-urllib3/1.26.9 May 19 13:45:22.249835 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Auth-Token: gAAAAABihkj6liBLvukkw2qtst-UG_cKJZiNcCgt6W_kQDYluV0QF-s3L61GELG86yuBU_XP0oEocHGYFB77RCnoJWx_PSe5oCa2SU8RfG2VbbO9_x7MK34OtxqKFCLvWQmkpMAhKbbulm_ByBEFHwsuhM1s6duzmOYoRlcr_Dq0_GCOhJ038Nk May 19 13:45:22.249835 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Domain-Id: None May 19 13:45:22.249835 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Domain-Name: None May 19 13:45:22.249835 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Identity-Status: Confirmed May 19 13:45:22.249835 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Is-Admin-Project: True May 19 13:45:22.249835 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Domain-Id: default May 19 13:45:22.249835 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Domain-Name: Default May 19 13:45:22.249835 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Id: bc560e8b75194743bbb46d903b481357 May 19 13:45:22.249835 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Name: tempest-AttachVolumeNegativeTest-35839424 May 19 13:45:22.249835 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Role: reader,member May 19 13:45:22.249835 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Roles: reader,member May 19 13:45:22.251439 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/bc560e8b75194743bbb46d903b481357"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/bc560e8b75194743bbb46d903b481357"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_bc560e8b75194743bbb46d903b481357", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/bc560e8b75194743bbb46d903b481357"}]}] May 19 13:45:22.251439 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Tenant: tempest-AttachVolumeNegativeTest-35839424 May 19 13:45:22.251439 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Tenant-Id: bc560e8b75194743bbb46d903b481357 May 19 13:45:22.251439 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-35839424 May 19 13:45:22.251439 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User: tempest-AttachVolumeNegativeTest-35839424-project May 19 13:45:22.251439 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Domain-Id: default May 19 13:45:22.251439 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Domain-Name: Default May 19 13:45:22.251439 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Id: daa4a2a39deb4e7ba54032acec14e029 May 19 13:45:22.251439 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Name: tempest-AttachVolumeNegativeTest-35839424-project May 19 13:45:22.251439 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: method: > May 19 13:45:22.251439 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: exception: Instance 50a5a1ba-fb03-4cb8-8037-1aeee7b99be4 could not be found. May 19 13:45:22.251439 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: action_args: {'id': '50a5a1ba-fb03-4cb8-8037-1aeee7b99be4'} May 19 13:45:22.252279 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:45:22.252279 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:45:22.252279 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 13:45:22.252279 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 13:45:22.252279 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 13:45:22.252279 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 13:45:22.252279 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 13:45:22.252279 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 13:45:22.252279 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 13:45:22.252279 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 13:45:22.252279 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50a5a1ba-fb03-4cb8-8037-1aeee7b99be4 could not be found. May 19 13:45:22.252279 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:45:22.252279 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:45:22.252279 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:45:22.252279 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:45:22.252279 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:45:22.252279 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:45:22.252279 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:45:22.252279 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:45:22.252279 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:45:22.254260 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:45:22.254260 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 13:45:22.254260 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 13:45:22.254260 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 13:45:22.254260 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 13:45:22.254260 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 13:45:22.254260 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 13:45:22.254260 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50a5a1ba-fb03-4cb8-8037-1aeee7b99be4 could not be found. May 19 13:45:22.254260 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:45:22.254260 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:45:22.254260 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:45:22.254260 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:45:22.254260 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:45:22.254260 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:45:22.254260 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:45:22.254260 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:45:22.254260 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50a5a1ba-fb03-4cb8-8037-1aeee7b99be4 could not be found. May 19 13:45:22.254260 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:45:22.255946 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-a60708c6-8a71-4417-a7e7-233258fe318c tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Returning 404 to user: Instance 50a5a1ba-fb03-4cb8-8037-1aeee7b99be4 could not be found. {{(pid=120471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:45:22.255946 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-a60708c6-8a71-4417-a7e7-233258fe318c tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "GET /compute/v2.1/servers/50a5a1ba-fb03-4cb8-8037-1aeee7b99be4" status: 404 len: 111 microversion: 2.1 time: 0.033778 May 19 13:45:22.255946 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 527/1037] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:45:22 2022] GET /compute/v2.1/servers/50a5a1ba-fb03-4cb8-8037-1aeee7b99be4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 13:45:22.262894 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-ec59e0cf-9085-4cec-b50d-f23c4044b0e9 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Calling method '.version_select at 0x7f7c2a75ad30>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:45:22.283289 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-ec59e0cf-9085-4cec-b50d-f23c4044b0e9 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1994418017" status: 202 len: 0 microversion: 2.1 time: 0.025546 May 19 13:45:22.287059 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 511/1038] 10.222.0.24 () {58 vars in 1220 bytes} [Thu May 19 13:45:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1994418017 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 13:45:24.339517 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-25f41587-eb2f-49ac-b22b-f2c84117d28b tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:45:24.340009 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-25f41587-eb2f-49ac-b22b-f2c84117d28b tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: 50a5a1ba-fb03-4cb8-8037-1aeee7b99be4] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:45:24.347010 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-25f41587-eb2f-49ac-b22b-f2c84117d28b tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:45:24.347454 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-25f41587-eb2f-49ac-b22b-f2c84117d28b tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:45:24.348213 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-25f41587-eb2f-49ac-b22b-f2c84117d28b tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:45:24.348642 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-25f41587-eb2f-49ac-b22b-f2c84117d28b tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:45:24.364668 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.wsgi [None req-25f41587-eb2f-49ac-b22b-f2c84117d28b tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] HTTP exception thrown: Instance 50a5a1ba-fb03-4cb8-8037-1aeee7b99be4 could not be found. May 19 13:45:24.366260 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-25f41587-eb2f-49ac-b22b-f2c84117d28b tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Request method failure captured: May 19 13:45:24.366260 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: request: DELETE /compute/v2.1/servers/50a5a1ba-fb03-4cb8-8037-1aeee7b99be4 HTTP/1.1 May 19 13:45:24.366260 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Accept: application/json May 19 13:45:24.366260 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Accept-Encoding: identity May 19 13:45:24.366260 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Connection: close May 19 13:45:24.366260 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Content-Length: 0 May 19 13:45:24.366260 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Content-Type: application/json May 19 13:45:24.366260 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Host: 10.222.0.24 May 19 13:45:24.366260 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Openstack-System-Scope: None May 19 13:45:24.366260 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: User-Agent: python-urllib3/1.26.9 May 19 13:45:24.366260 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Auth-Token: gAAAAABihkj6liBLvukkw2qtst-UG_cKJZiNcCgt6W_kQDYluV0QF-s3L61GELG86yuBU_XP0oEocHGYFB77RCnoJWx_PSe5oCa2SU8RfG2VbbO9_x7MK34OtxqKFCLvWQmkpMAhKbbulm_ByBEFHwsuhM1s6duzmOYoRlcr_Dq0_GCOhJ038Nk May 19 13:45:24.366260 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Domain-Id: None May 19 13:45:24.366260 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Domain-Name: None May 19 13:45:24.366260 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Identity-Status: Confirmed May 19 13:45:24.366260 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Is-Admin-Project: True May 19 13:45:24.366260 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Domain-Id: default May 19 13:45:24.366260 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Domain-Name: Default May 19 13:45:24.366260 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Id: bc560e8b75194743bbb46d903b481357 May 19 13:45:24.366260 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Name: tempest-AttachVolumeNegativeTest-35839424 May 19 13:45:24.366260 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Role: reader,member May 19 13:45:24.366260 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Roles: reader,member May 19 13:45:24.367836 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/bc560e8b75194743bbb46d903b481357"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/bc560e8b75194743bbb46d903b481357"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_bc560e8b75194743bbb46d903b481357", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/bc560e8b75194743bbb46d903b481357"}]}] May 19 13:45:24.367836 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Tenant: tempest-AttachVolumeNegativeTest-35839424 May 19 13:45:24.367836 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Tenant-Id: bc560e8b75194743bbb46d903b481357 May 19 13:45:24.367836 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-35839424 May 19 13:45:24.367836 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User: tempest-AttachVolumeNegativeTest-35839424-project May 19 13:45:24.367836 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Domain-Id: default May 19 13:45:24.367836 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Domain-Name: Default May 19 13:45:24.367836 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Id: daa4a2a39deb4e7ba54032acec14e029 May 19 13:45:24.367836 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Name: tempest-AttachVolumeNegativeTest-35839424-project May 19 13:45:24.367836 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: method: > May 19 13:45:24.367836 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: exception: Instance 50a5a1ba-fb03-4cb8-8037-1aeee7b99be4 could not be found. May 19 13:45:24.367836 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: action_args: {'id': '50a5a1ba-fb03-4cb8-8037-1aeee7b99be4'} May 19 13:45:24.368676 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:45:24.368676 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:45:24.368676 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 13:45:24.368676 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 13:45:24.368676 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 13:45:24.368676 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 13:45:24.368676 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 13:45:24.368676 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 13:45:24.368676 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 13:45:24.368676 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 13:45:24.368676 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50a5a1ba-fb03-4cb8-8037-1aeee7b99be4 could not be found. May 19 13:45:24.368676 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:45:24.368676 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:45:24.368676 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:45:24.368676 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:45:24.368676 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:45:24.368676 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:45:24.368676 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:45:24.368676 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:45:24.368676 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:45:24.370274 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:45:24.370274 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 13:45:24.370274 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 13:45:24.370274 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 13:45:24.370274 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 13:45:24.370274 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 13:45:24.370274 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 13:45:24.370274 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 13:45:24.370274 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 13:45:24.370274 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50a5a1ba-fb03-4cb8-8037-1aeee7b99be4 could not be found. May 19 13:45:24.370274 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:45:24.370274 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:45:24.370274 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:45:24.370274 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:45:24.370274 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:45:24.370274 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:45:24.370274 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:45:24.370274 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:45:24.370274 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50a5a1ba-fb03-4cb8-8037-1aeee7b99be4 could not be found. May 19 13:45:24.370274 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:45:24.371626 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-25f41587-eb2f-49ac-b22b-f2c84117d28b tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Returning 404 to user: Instance 50a5a1ba-fb03-4cb8-8037-1aeee7b99be4 could not be found. {{(pid=120471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:45:24.371626 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-25f41587-eb2f-49ac-b22b-f2c84117d28b tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "DELETE /compute/v2.1/servers/50a5a1ba-fb03-4cb8-8037-1aeee7b99be4" status: 404 len: 111 microversion: 2.1 time: 0.032355 May 19 13:45:24.371626 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 528/1039] 10.222.0.24 () {58 vars in 1238 bytes} [Thu May 19 13:45:24 2022] DELETE /compute/v2.1/servers/50a5a1ba-fb03-4cb8-8037-1aeee7b99be4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 13:45:24.376863 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-bcac93dc-3c69-4a17-bc5e-f83f6ad5394e tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:45:24.377640 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-bcac93dc-3c69-4a17-bc5e-f83f6ad5394e tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: 50a5a1ba-fb03-4cb8-8037-1aeee7b99be4] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:45:24.384835 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-bcac93dc-3c69-4a17-bc5e-f83f6ad5394e tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:45:24.385402 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-bcac93dc-3c69-4a17-bc5e-f83f6ad5394e tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:45:24.386198 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-bcac93dc-3c69-4a17-bc5e-f83f6ad5394e tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:45:24.386630 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-bcac93dc-3c69-4a17-bc5e-f83f6ad5394e tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:45:24.400195 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.wsgi [None req-bcac93dc-3c69-4a17-bc5e-f83f6ad5394e tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] HTTP exception thrown: Instance 50a5a1ba-fb03-4cb8-8037-1aeee7b99be4 could not be found. May 19 13:45:24.401995 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-bcac93dc-3c69-4a17-bc5e-f83f6ad5394e tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Request method failure captured: May 19 13:45:24.401995 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: request: GET /compute/v2.1/servers/50a5a1ba-fb03-4cb8-8037-1aeee7b99be4 HTTP/1.1 May 19 13:45:24.401995 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Accept: application/json May 19 13:45:24.401995 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Accept-Encoding: identity May 19 13:45:24.401995 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Connection: close May 19 13:45:24.401995 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Content-Length: 0 May 19 13:45:24.401995 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Content-Type: application/json May 19 13:45:24.401995 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Host: 10.222.0.24 May 19 13:45:24.401995 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Openstack-System-Scope: None May 19 13:45:24.401995 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: User-Agent: python-urllib3/1.26.9 May 19 13:45:24.401995 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Auth-Token: gAAAAABihkj6liBLvukkw2qtst-UG_cKJZiNcCgt6W_kQDYluV0QF-s3L61GELG86yuBU_XP0oEocHGYFB77RCnoJWx_PSe5oCa2SU8RfG2VbbO9_x7MK34OtxqKFCLvWQmkpMAhKbbulm_ByBEFHwsuhM1s6duzmOYoRlcr_Dq0_GCOhJ038Nk May 19 13:45:24.401995 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Domain-Id: None May 19 13:45:24.401995 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Domain-Name: None May 19 13:45:24.401995 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Identity-Status: Confirmed May 19 13:45:24.401995 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Is-Admin-Project: True May 19 13:45:24.401995 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Domain-Id: default May 19 13:45:24.401995 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Domain-Name: Default May 19 13:45:24.401995 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Id: bc560e8b75194743bbb46d903b481357 May 19 13:45:24.401995 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Name: tempest-AttachVolumeNegativeTest-35839424 May 19 13:45:24.401995 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Role: reader,member May 19 13:45:24.401995 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Roles: reader,member May 19 13:45:24.403629 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/bc560e8b75194743bbb46d903b481357"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/bc560e8b75194743bbb46d903b481357"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_bc560e8b75194743bbb46d903b481357", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/bc560e8b75194743bbb46d903b481357"}]}] May 19 13:45:24.403629 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant: tempest-AttachVolumeNegativeTest-35839424 May 19 13:45:24.403629 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant-Id: bc560e8b75194743bbb46d903b481357 May 19 13:45:24.403629 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-35839424 May 19 13:45:24.403629 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User: tempest-AttachVolumeNegativeTest-35839424-project May 19 13:45:24.403629 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Domain-Id: default May 19 13:45:24.403629 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Domain-Name: Default May 19 13:45:24.403629 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Id: daa4a2a39deb4e7ba54032acec14e029 May 19 13:45:24.403629 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Name: tempest-AttachVolumeNegativeTest-35839424-project May 19 13:45:24.403629 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: method: > May 19 13:45:24.403629 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: exception: Instance 50a5a1ba-fb03-4cb8-8037-1aeee7b99be4 could not be found. May 19 13:45:24.403629 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: action_args: {'id': '50a5a1ba-fb03-4cb8-8037-1aeee7b99be4'} May 19 13:45:24.404462 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:45:24.404462 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:45:24.404462 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 13:45:24.404462 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 13:45:24.404462 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 13:45:24.404462 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 13:45:24.404462 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 13:45:24.404462 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 13:45:24.404462 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 13:45:24.404462 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 13:45:24.404462 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50a5a1ba-fb03-4cb8-8037-1aeee7b99be4 could not be found. May 19 13:45:24.404462 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:45:24.404462 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:45:24.404462 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:45:24.404462 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:45:24.404462 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:45:24.404462 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:45:24.404462 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:45:24.404462 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:45:24.404462 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:45:24.405786 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:45:24.405786 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 13:45:24.405786 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 13:45:24.405786 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 13:45:24.405786 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 13:45:24.405786 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 13:45:24.405786 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 13:45:24.405786 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50a5a1ba-fb03-4cb8-8037-1aeee7b99be4 could not be found. May 19 13:45:24.405786 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:45:24.405786 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:45:24.405786 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:45:24.405786 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:45:24.405786 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:45:24.405786 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:45:24.405786 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:45:24.405786 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:45:24.405786 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50a5a1ba-fb03-4cb8-8037-1aeee7b99be4 could not be found. May 19 13:45:24.405786 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:45:24.406936 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-bcac93dc-3c69-4a17-bc5e-f83f6ad5394e tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Returning 404 to user: Instance 50a5a1ba-fb03-4cb8-8037-1aeee7b99be4 could not be found. {{(pid=120472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:45:24.406936 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-bcac93dc-3c69-4a17-bc5e-f83f6ad5394e tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "GET /compute/v2.1/servers/50a5a1ba-fb03-4cb8-8037-1aeee7b99be4" status: 404 len: 111 microversion: 2.1 time: 0.030890 May 19 13:45:24.406936 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 512/1040] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:45:24 2022] GET /compute/v2.1/servers/50a5a1ba-fb03-4cb8-8037-1aeee7b99be4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 13:45:25.550979 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-b4a44ac1-c43f-497f-86f2-54f742d46b27 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:45:25.551512 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-b4a44ac1-c43f-497f-86f2-54f742d46b27 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: 69b0d8dd-4d36-4174-991d-46f31a266b9f] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:45:25.558541 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-b4a44ac1-c43f-497f-86f2-54f742d46b27 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:45:25.558991 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-b4a44ac1-c43f-497f-86f2-54f742d46b27 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:45:25.560196 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-b4a44ac1-c43f-497f-86f2-54f742d46b27 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:45:25.560719 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-b4a44ac1-c43f-497f-86f2-54f742d46b27 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:45:25.574801 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.wsgi [None req-b4a44ac1-c43f-497f-86f2-54f742d46b27 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] HTTP exception thrown: Instance 69b0d8dd-4d36-4174-991d-46f31a266b9f could not be found. May 19 13:45:25.576883 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-b4a44ac1-c43f-497f-86f2-54f742d46b27 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Request method failure captured: May 19 13:45:25.576883 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: request: DELETE /compute/v2.1/servers/69b0d8dd-4d36-4174-991d-46f31a266b9f HTTP/1.1 May 19 13:45:25.576883 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Accept: application/json May 19 13:45:25.576883 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Accept-Encoding: identity May 19 13:45:25.576883 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Connection: close May 19 13:45:25.576883 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Content-Length: 0 May 19 13:45:25.576883 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Content-Type: application/json May 19 13:45:25.576883 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Host: 10.222.0.24 May 19 13:45:25.576883 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Openstack-System-Scope: None May 19 13:45:25.576883 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: User-Agent: python-urllib3/1.26.9 May 19 13:45:25.576883 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Auth-Token: gAAAAABihkj6liBLvukkw2qtst-UG_cKJZiNcCgt6W_kQDYluV0QF-s3L61GELG86yuBU_XP0oEocHGYFB77RCnoJWx_PSe5oCa2SU8RfG2VbbO9_x7MK34OtxqKFCLvWQmkpMAhKbbulm_ByBEFHwsuhM1s6duzmOYoRlcr_Dq0_GCOhJ038Nk May 19 13:45:25.576883 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Domain-Id: None May 19 13:45:25.576883 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Domain-Name: None May 19 13:45:25.576883 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Identity-Status: Confirmed May 19 13:45:25.576883 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Is-Admin-Project: True May 19 13:45:25.576883 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Domain-Id: default May 19 13:45:25.576883 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Domain-Name: Default May 19 13:45:25.576883 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Id: bc560e8b75194743bbb46d903b481357 May 19 13:45:25.576883 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Name: tempest-AttachVolumeNegativeTest-35839424 May 19 13:45:25.576883 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Role: reader,member May 19 13:45:25.576883 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Roles: reader,member May 19 13:45:25.578504 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/bc560e8b75194743bbb46d903b481357"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/bc560e8b75194743bbb46d903b481357"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_bc560e8b75194743bbb46d903b481357", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/bc560e8b75194743bbb46d903b481357"}]}] May 19 13:45:25.578504 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Tenant: tempest-AttachVolumeNegativeTest-35839424 May 19 13:45:25.578504 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Tenant-Id: bc560e8b75194743bbb46d903b481357 May 19 13:45:25.578504 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-35839424 May 19 13:45:25.578504 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User: tempest-AttachVolumeNegativeTest-35839424-project May 19 13:45:25.578504 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Domain-Id: default May 19 13:45:25.578504 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Domain-Name: Default May 19 13:45:25.578504 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Id: daa4a2a39deb4e7ba54032acec14e029 May 19 13:45:25.578504 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Name: tempest-AttachVolumeNegativeTest-35839424-project May 19 13:45:25.578504 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: method: > May 19 13:45:25.578504 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: exception: Instance 69b0d8dd-4d36-4174-991d-46f31a266b9f could not be found. May 19 13:45:25.578504 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: action_args: {'id': '69b0d8dd-4d36-4174-991d-46f31a266b9f'} May 19 13:45:25.579509 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:45:25.579509 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:45:25.579509 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 13:45:25.579509 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 13:45:25.579509 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 13:45:25.579509 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 13:45:25.579509 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 13:45:25.579509 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 13:45:25.579509 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 13:45:25.579509 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 13:45:25.579509 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69b0d8dd-4d36-4174-991d-46f31a266b9f could not be found. May 19 13:45:25.579509 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:45:25.579509 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:45:25.579509 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:45:25.579509 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:45:25.579509 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:45:25.579509 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:45:25.579509 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:45:25.579509 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:45:25.579509 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:45:25.581066 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:45:25.581066 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 13:45:25.581066 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 13:45:25.581066 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 13:45:25.581066 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 13:45:25.581066 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 13:45:25.581066 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 13:45:25.581066 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 13:45:25.581066 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 13:45:25.581066 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69b0d8dd-4d36-4174-991d-46f31a266b9f could not be found. May 19 13:45:25.581066 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:45:25.581066 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:45:25.581066 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:45:25.581066 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:45:25.581066 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:45:25.581066 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:45:25.581066 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:45:25.581066 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:45:25.581066 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69b0d8dd-4d36-4174-991d-46f31a266b9f could not be found. May 19 13:45:25.581066 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:45:25.582945 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-b4a44ac1-c43f-497f-86f2-54f742d46b27 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Returning 404 to user: Instance 69b0d8dd-4d36-4174-991d-46f31a266b9f could not be found. {{(pid=120471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:45:25.582945 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-b4a44ac1-c43f-497f-86f2-54f742d46b27 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "DELETE /compute/v2.1/servers/69b0d8dd-4d36-4174-991d-46f31a266b9f" status: 404 len: 111 microversion: 2.1 time: 0.031270 May 19 13:45:25.582945 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 529/1041] 10.222.0.24 () {58 vars in 1238 bytes} [Thu May 19 13:45:25 2022] DELETE /compute/v2.1/servers/69b0d8dd-4d36-4174-991d-46f31a266b9f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 13:45:25.586701 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-aacc5667-0844-423d-90ff-619a80c5f37f tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:45:25.587311 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-aacc5667-0844-423d-90ff-619a80c5f37f tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: 69b0d8dd-4d36-4174-991d-46f31a266b9f] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:45:25.594753 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-aacc5667-0844-423d-90ff-619a80c5f37f tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:45:25.595198 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-aacc5667-0844-423d-90ff-619a80c5f37f tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:45:25.595965 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-aacc5667-0844-423d-90ff-619a80c5f37f tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:45:25.596393 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-aacc5667-0844-423d-90ff-619a80c5f37f tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:45:25.610436 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.wsgi [None req-aacc5667-0844-423d-90ff-619a80c5f37f tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] HTTP exception thrown: Instance 69b0d8dd-4d36-4174-991d-46f31a266b9f could not be found. May 19 13:45:25.611952 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-aacc5667-0844-423d-90ff-619a80c5f37f tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Request method failure captured: May 19 13:45:25.611952 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: request: GET /compute/v2.1/servers/69b0d8dd-4d36-4174-991d-46f31a266b9f HTTP/1.1 May 19 13:45:25.611952 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Accept: application/json May 19 13:45:25.611952 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Accept-Encoding: identity May 19 13:45:25.611952 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Connection: close May 19 13:45:25.611952 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Content-Length: 0 May 19 13:45:25.611952 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Content-Type: application/json May 19 13:45:25.611952 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Host: 10.222.0.24 May 19 13:45:25.611952 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Openstack-System-Scope: None May 19 13:45:25.611952 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: User-Agent: python-urllib3/1.26.9 May 19 13:45:25.611952 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Auth-Token: gAAAAABihkj6liBLvukkw2qtst-UG_cKJZiNcCgt6W_kQDYluV0QF-s3L61GELG86yuBU_XP0oEocHGYFB77RCnoJWx_PSe5oCa2SU8RfG2VbbO9_x7MK34OtxqKFCLvWQmkpMAhKbbulm_ByBEFHwsuhM1s6duzmOYoRlcr_Dq0_GCOhJ038Nk May 19 13:45:25.611952 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Domain-Id: None May 19 13:45:25.611952 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Domain-Name: None May 19 13:45:25.611952 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Identity-Status: Confirmed May 19 13:45:25.611952 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Is-Admin-Project: True May 19 13:45:25.611952 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Domain-Id: default May 19 13:45:25.611952 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Domain-Name: Default May 19 13:45:25.611952 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Id: bc560e8b75194743bbb46d903b481357 May 19 13:45:25.611952 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Name: tempest-AttachVolumeNegativeTest-35839424 May 19 13:45:25.611952 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Role: reader,member May 19 13:45:25.611952 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Roles: reader,member May 19 13:45:25.613659 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/bc560e8b75194743bbb46d903b481357"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/bc560e8b75194743bbb46d903b481357"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_bc560e8b75194743bbb46d903b481357", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/bc560e8b75194743bbb46d903b481357"}]}] May 19 13:45:25.613659 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant: tempest-AttachVolumeNegativeTest-35839424 May 19 13:45:25.613659 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant-Id: bc560e8b75194743bbb46d903b481357 May 19 13:45:25.613659 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-35839424 May 19 13:45:25.613659 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User: tempest-AttachVolumeNegativeTest-35839424-project May 19 13:45:25.613659 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Domain-Id: default May 19 13:45:25.613659 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Domain-Name: Default May 19 13:45:25.613659 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Id: daa4a2a39deb4e7ba54032acec14e029 May 19 13:45:25.613659 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Name: tempest-AttachVolumeNegativeTest-35839424-project May 19 13:45:25.613659 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: method: > May 19 13:45:25.613659 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: exception: Instance 69b0d8dd-4d36-4174-991d-46f31a266b9f could not be found. May 19 13:45:25.613659 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: action_args: {'id': '69b0d8dd-4d36-4174-991d-46f31a266b9f'} May 19 13:45:25.614617 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:45:25.614617 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:45:25.614617 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 13:45:25.614617 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 13:45:25.614617 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 13:45:25.614617 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 13:45:25.614617 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 13:45:25.614617 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 13:45:25.614617 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 13:45:25.614617 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 13:45:25.614617 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69b0d8dd-4d36-4174-991d-46f31a266b9f could not be found. May 19 13:45:25.614617 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:45:25.614617 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:45:25.614617 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:45:25.614617 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:45:25.614617 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:45:25.614617 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:45:25.614617 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:45:25.614617 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:45:25.614617 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:45:25.616203 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:45:25.616203 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 13:45:25.616203 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 13:45:25.616203 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 13:45:25.616203 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 13:45:25.616203 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 13:45:25.616203 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 13:45:25.616203 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69b0d8dd-4d36-4174-991d-46f31a266b9f could not be found. May 19 13:45:25.616203 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:45:25.616203 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:45:25.616203 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:45:25.616203 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:45:25.616203 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:45:25.616203 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:45:25.616203 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:45:25.616203 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:45:25.616203 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69b0d8dd-4d36-4174-991d-46f31a266b9f could not be found. May 19 13:45:25.616203 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:45:25.617675 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-aacc5667-0844-423d-90ff-619a80c5f37f tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Returning 404 to user: Instance 69b0d8dd-4d36-4174-991d-46f31a266b9f could not be found. {{(pid=120472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:45:25.617675 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-aacc5667-0844-423d-90ff-619a80c5f37f tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "GET /compute/v2.1/servers/69b0d8dd-4d36-4174-991d-46f31a266b9f" status: 404 len: 111 microversion: 2.1 time: 0.030499 May 19 13:45:25.617675 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 513/1042] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:45:25 2022] GET /compute/v2.1/servers/69b0d8dd-4d36-4174-991d-46f31a266b9f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 13:45:25.623415 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-5d79d41c-fe09-4d48-aadc-47caf1611a49 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:45:25.623903 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-5d79d41c-fe09-4d48-aadc-47caf1611a49 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: d4831f4e-33ee-459b-ac94-43ffe068e9fc] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:45:25.630536 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-5d79d41c-fe09-4d48-aadc-47caf1611a49 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:45:25.630980 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-5d79d41c-fe09-4d48-aadc-47caf1611a49 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:45:25.631724 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-5d79d41c-fe09-4d48-aadc-47caf1611a49 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:45:25.632145 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-5d79d41c-fe09-4d48-aadc-47caf1611a49 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:45:25.645962 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.wsgi [None req-5d79d41c-fe09-4d48-aadc-47caf1611a49 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] HTTP exception thrown: Instance d4831f4e-33ee-459b-ac94-43ffe068e9fc could not be found. May 19 13:45:25.647510 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-5d79d41c-fe09-4d48-aadc-47caf1611a49 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Request method failure captured: May 19 13:45:25.647510 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: request: DELETE /compute/v2.1/servers/d4831f4e-33ee-459b-ac94-43ffe068e9fc HTTP/1.1 May 19 13:45:25.647510 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Accept: application/json May 19 13:45:25.647510 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Accept-Encoding: identity May 19 13:45:25.647510 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Connection: close May 19 13:45:25.647510 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Content-Length: 0 May 19 13:45:25.647510 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Content-Type: application/json May 19 13:45:25.647510 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Host: 10.222.0.24 May 19 13:45:25.647510 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Openstack-System-Scope: None May 19 13:45:25.647510 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: User-Agent: python-urllib3/1.26.9 May 19 13:45:25.647510 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Auth-Token: gAAAAABihkj6liBLvukkw2qtst-UG_cKJZiNcCgt6W_kQDYluV0QF-s3L61GELG86yuBU_XP0oEocHGYFB77RCnoJWx_PSe5oCa2SU8RfG2VbbO9_x7MK34OtxqKFCLvWQmkpMAhKbbulm_ByBEFHwsuhM1s6duzmOYoRlcr_Dq0_GCOhJ038Nk May 19 13:45:25.647510 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Domain-Id: None May 19 13:45:25.647510 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Domain-Name: None May 19 13:45:25.647510 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Identity-Status: Confirmed May 19 13:45:25.647510 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Is-Admin-Project: True May 19 13:45:25.647510 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Domain-Id: default May 19 13:45:25.647510 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Domain-Name: Default May 19 13:45:25.647510 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Id: bc560e8b75194743bbb46d903b481357 May 19 13:45:25.647510 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Name: tempest-AttachVolumeNegativeTest-35839424 May 19 13:45:25.647510 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Role: reader,member May 19 13:45:25.647510 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Roles: reader,member May 19 13:45:25.649174 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/bc560e8b75194743bbb46d903b481357"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/bc560e8b75194743bbb46d903b481357"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_bc560e8b75194743bbb46d903b481357", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/bc560e8b75194743bbb46d903b481357"}]}] May 19 13:45:25.649174 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Tenant: tempest-AttachVolumeNegativeTest-35839424 May 19 13:45:25.649174 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Tenant-Id: bc560e8b75194743bbb46d903b481357 May 19 13:45:25.649174 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-35839424 May 19 13:45:25.649174 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User: tempest-AttachVolumeNegativeTest-35839424-project May 19 13:45:25.649174 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Domain-Id: default May 19 13:45:25.649174 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Domain-Name: Default May 19 13:45:25.649174 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Id: daa4a2a39deb4e7ba54032acec14e029 May 19 13:45:25.649174 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Name: tempest-AttachVolumeNegativeTest-35839424-project May 19 13:45:25.649174 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: method: > May 19 13:45:25.649174 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: exception: Instance d4831f4e-33ee-459b-ac94-43ffe068e9fc could not be found. May 19 13:45:25.649174 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: action_args: {'id': 'd4831f4e-33ee-459b-ac94-43ffe068e9fc'} May 19 13:45:25.650034 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:45:25.650034 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:45:25.650034 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 13:45:25.650034 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 13:45:25.650034 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 13:45:25.650034 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 13:45:25.650034 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 13:45:25.650034 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 13:45:25.650034 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 13:45:25.650034 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 13:45:25.650034 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4831f4e-33ee-459b-ac94-43ffe068e9fc could not be found. May 19 13:45:25.650034 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:45:25.650034 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:45:25.650034 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:45:25.650034 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:45:25.650034 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:45:25.650034 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:45:25.650034 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:45:25.650034 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:45:25.650034 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:45:25.651347 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:45:25.651347 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 13:45:25.651347 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 13:45:25.651347 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 13:45:25.651347 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 13:45:25.651347 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 13:45:25.651347 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 13:45:25.651347 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 13:45:25.651347 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 13:45:25.651347 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4831f4e-33ee-459b-ac94-43ffe068e9fc could not be found. May 19 13:45:25.651347 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:45:25.651347 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:45:25.651347 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:45:25.651347 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:45:25.651347 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:45:25.651347 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:45:25.651347 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:45:25.651347 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:45:25.651347 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4831f4e-33ee-459b-ac94-43ffe068e9fc could not be found. May 19 13:45:25.651347 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:45:25.652724 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-5d79d41c-fe09-4d48-aadc-47caf1611a49 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Returning 404 to user: Instance d4831f4e-33ee-459b-ac94-43ffe068e9fc could not be found. {{(pid=120471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:45:25.652724 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-5d79d41c-fe09-4d48-aadc-47caf1611a49 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "DELETE /compute/v2.1/servers/d4831f4e-33ee-459b-ac94-43ffe068e9fc" status: 404 len: 111 microversion: 2.1 time: 0.030843 May 19 13:45:25.652724 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 530/1043] 10.222.0.24 () {58 vars in 1238 bytes} [Thu May 19 13:45:25 2022] DELETE /compute/v2.1/servers/d4831f4e-33ee-459b-ac94-43ffe068e9fc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 13:45:25.660172 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-4984312c-522e-467b-a00b-524e85c7f03b tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:45:25.661062 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-4984312c-522e-467b-a00b-524e85c7f03b tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: d4831f4e-33ee-459b-ac94-43ffe068e9fc] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:45:25.670389 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-4984312c-522e-467b-a00b-524e85c7f03b tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:45:25.670829 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-4984312c-522e-467b-a00b-524e85c7f03b tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:45:25.671578 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-4984312c-522e-467b-a00b-524e85c7f03b tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:45:25.672001 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-4984312c-522e-467b-a00b-524e85c7f03b tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:45:25.685715 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.wsgi [None req-4984312c-522e-467b-a00b-524e85c7f03b tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] HTTP exception thrown: Instance d4831f4e-33ee-459b-ac94-43ffe068e9fc could not be found. May 19 13:45:25.687235 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-4984312c-522e-467b-a00b-524e85c7f03b tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Request method failure captured: May 19 13:45:25.687235 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: request: GET /compute/v2.1/servers/d4831f4e-33ee-459b-ac94-43ffe068e9fc HTTP/1.1 May 19 13:45:25.687235 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Accept: application/json May 19 13:45:25.687235 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Accept-Encoding: identity May 19 13:45:25.687235 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Connection: close May 19 13:45:25.687235 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Content-Length: 0 May 19 13:45:25.687235 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Content-Type: application/json May 19 13:45:25.687235 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Host: 10.222.0.24 May 19 13:45:25.687235 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Openstack-System-Scope: None May 19 13:45:25.687235 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: User-Agent: python-urllib3/1.26.9 May 19 13:45:25.687235 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Auth-Token: gAAAAABihkj6liBLvukkw2qtst-UG_cKJZiNcCgt6W_kQDYluV0QF-s3L61GELG86yuBU_XP0oEocHGYFB77RCnoJWx_PSe5oCa2SU8RfG2VbbO9_x7MK34OtxqKFCLvWQmkpMAhKbbulm_ByBEFHwsuhM1s6duzmOYoRlcr_Dq0_GCOhJ038Nk May 19 13:45:25.687235 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Domain-Id: None May 19 13:45:25.687235 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Domain-Name: None May 19 13:45:25.687235 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Identity-Status: Confirmed May 19 13:45:25.687235 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Is-Admin-Project: True May 19 13:45:25.687235 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Domain-Id: default May 19 13:45:25.687235 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Domain-Name: Default May 19 13:45:25.687235 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Id: bc560e8b75194743bbb46d903b481357 May 19 13:45:25.687235 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Name: tempest-AttachVolumeNegativeTest-35839424 May 19 13:45:25.687235 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Role: reader,member May 19 13:45:25.687235 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Roles: reader,member May 19 13:45:25.688839 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/bc560e8b75194743bbb46d903b481357"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/bc560e8b75194743bbb46d903b481357"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_bc560e8b75194743bbb46d903b481357", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/bc560e8b75194743bbb46d903b481357"}]}] May 19 13:45:25.688839 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant: tempest-AttachVolumeNegativeTest-35839424 May 19 13:45:25.688839 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant-Id: bc560e8b75194743bbb46d903b481357 May 19 13:45:25.688839 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-35839424 May 19 13:45:25.688839 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User: tempest-AttachVolumeNegativeTest-35839424-project May 19 13:45:25.688839 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Domain-Id: default May 19 13:45:25.688839 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Domain-Name: Default May 19 13:45:25.688839 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Id: daa4a2a39deb4e7ba54032acec14e029 May 19 13:45:25.688839 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Name: tempest-AttachVolumeNegativeTest-35839424-project May 19 13:45:25.688839 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: method: > May 19 13:45:25.688839 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: exception: Instance d4831f4e-33ee-459b-ac94-43ffe068e9fc could not be found. May 19 13:45:25.688839 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: action_args: {'id': 'd4831f4e-33ee-459b-ac94-43ffe068e9fc'} May 19 13:45:25.689802 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:45:25.689802 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:45:25.689802 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 13:45:25.689802 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 13:45:25.689802 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 13:45:25.689802 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 13:45:25.689802 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 13:45:25.689802 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 13:45:25.689802 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 13:45:25.689802 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 13:45:25.689802 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4831f4e-33ee-459b-ac94-43ffe068e9fc could not be found. May 19 13:45:25.689802 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:45:25.689802 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:45:25.689802 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:45:25.689802 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:45:25.689802 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:45:25.689802 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:45:25.689802 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:45:25.689802 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:45:25.689802 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:45:25.691359 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:45:25.691359 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 13:45:25.691359 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 13:45:25.691359 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 13:45:25.691359 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 13:45:25.691359 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 13:45:25.691359 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 13:45:25.691359 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4831f4e-33ee-459b-ac94-43ffe068e9fc could not be found. May 19 13:45:25.691359 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:45:25.691359 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:45:25.691359 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:45:25.691359 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:45:25.691359 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:45:25.691359 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:45:25.691359 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:45:25.691359 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:45:25.691359 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4831f4e-33ee-459b-ac94-43ffe068e9fc could not be found. May 19 13:45:25.691359 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:45:25.692737 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-4984312c-522e-467b-a00b-524e85c7f03b tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Returning 404 to user: Instance d4831f4e-33ee-459b-ac94-43ffe068e9fc could not be found. {{(pid=120472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:45:25.692737 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-4984312c-522e-467b-a00b-524e85c7f03b tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "GET /compute/v2.1/servers/d4831f4e-33ee-459b-ac94-43ffe068e9fc" status: 404 len: 111 microversion: 2.1 time: 0.034974 May 19 13:45:25.692737 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 514/1044] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:45:25 2022] GET /compute/v2.1/servers/d4831f4e-33ee-459b-ac94-43ffe068e9fc => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 13:45:26.833116 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-8c29f2e9-2893-4a9a-8736-7596b41dbe3c tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Calling method '>' {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:45:26.833698 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.compute.api [None req-8c29f2e9-2893-4a9a-8736-7596b41dbe3c tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: fbe881d3-e162-43fb-a5d8-0c954d016ad3] Fetching instance by UUID {{(pid=120471) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:45:26.840382 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-8c29f2e9-2893-4a9a-8736-7596b41dbe3c tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:45:26.840824 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-8c29f2e9-2893-4a9a-8736-7596b41dbe3c tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:45:26.842413 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-8c29f2e9-2893-4a9a-8736-7596b41dbe3c tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:45:26.842862 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG oslo_concurrency.lockutils [None req-8c29f2e9-2893-4a9a-8736-7596b41dbe3c tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:45:26.857019 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.wsgi [None req-8c29f2e9-2893-4a9a-8736-7596b41dbe3c tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] HTTP exception thrown: Instance fbe881d3-e162-43fb-a5d8-0c954d016ad3 could not be found. May 19 13:45:26.858711 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-8c29f2e9-2893-4a9a-8736-7596b41dbe3c tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Request method failure captured: May 19 13:45:26.858711 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: request: DELETE /compute/v2.1/servers/fbe881d3-e162-43fb-a5d8-0c954d016ad3 HTTP/1.1 May 19 13:45:26.858711 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Accept: application/json May 19 13:45:26.858711 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Accept-Encoding: identity May 19 13:45:26.858711 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Connection: close May 19 13:45:26.858711 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Content-Length: 0 May 19 13:45:26.858711 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Content-Type: application/json May 19 13:45:26.858711 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Host: 10.222.0.24 May 19 13:45:26.858711 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Openstack-System-Scope: None May 19 13:45:26.858711 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: User-Agent: python-urllib3/1.26.9 May 19 13:45:26.858711 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Auth-Token: gAAAAABihkj6liBLvukkw2qtst-UG_cKJZiNcCgt6W_kQDYluV0QF-s3L61GELG86yuBU_XP0oEocHGYFB77RCnoJWx_PSe5oCa2SU8RfG2VbbO9_x7MK34OtxqKFCLvWQmkpMAhKbbulm_ByBEFHwsuhM1s6duzmOYoRlcr_Dq0_GCOhJ038Nk May 19 13:45:26.858711 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Domain-Id: None May 19 13:45:26.858711 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Domain-Name: None May 19 13:45:26.858711 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Identity-Status: Confirmed May 19 13:45:26.858711 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Is-Admin-Project: True May 19 13:45:26.858711 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Domain-Id: default May 19 13:45:26.858711 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Domain-Name: Default May 19 13:45:26.858711 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Id: bc560e8b75194743bbb46d903b481357 May 19 13:45:26.858711 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Project-Name: tempest-AttachVolumeNegativeTest-35839424 May 19 13:45:26.858711 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Role: reader,member May 19 13:45:26.858711 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Roles: reader,member May 19 13:45:26.860314 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/bc560e8b75194743bbb46d903b481357"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/bc560e8b75194743bbb46d903b481357"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_bc560e8b75194743bbb46d903b481357", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/bc560e8b75194743bbb46d903b481357"}]}] May 19 13:45:26.860314 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Tenant: tempest-AttachVolumeNegativeTest-35839424 May 19 13:45:26.860314 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Tenant-Id: bc560e8b75194743bbb46d903b481357 May 19 13:45:26.860314 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-35839424 May 19 13:45:26.860314 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User: tempest-AttachVolumeNegativeTest-35839424-project May 19 13:45:26.860314 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Domain-Id: default May 19 13:45:26.860314 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Domain-Name: Default May 19 13:45:26.860314 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Id: daa4a2a39deb4e7ba54032acec14e029 May 19 13:45:26.860314 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: X-User-Name: tempest-AttachVolumeNegativeTest-35839424-project May 19 13:45:26.860314 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: method: > May 19 13:45:26.860314 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: exception: Instance fbe881d3-e162-43fb-a5d8-0c954d016ad3 could not be found. May 19 13:45:26.860314 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: action_args: {'id': 'fbe881d3-e162-43fb-a5d8-0c954d016ad3'} May 19 13:45:26.861285 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: {{(pid=120471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:45:26.861285 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:45:26.861285 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 13:45:26.861285 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 13:45:26.861285 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 13:45:26.861285 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 13:45:26.861285 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 13:45:26.861285 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 13:45:26.861285 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 13:45:26.861285 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 13:45:26.861285 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbe881d3-e162-43fb-a5d8-0c954d016ad3 could not be found. May 19 13:45:26.861285 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:45:26.861285 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:45:26.861285 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:45:26.861285 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:45:26.861285 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:45:26.861285 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:45:26.861285 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:45:26.861285 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:45:26.861285 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:45:26.862865 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:45:26.862865 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 13:45:26.862865 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 13:45:26.862865 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 13:45:26.862865 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 13:45:26.862865 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 13:45:26.862865 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 13:45:26.862865 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 13:45:26.862865 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 13:45:26.862865 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbe881d3-e162-43fb-a5d8-0c954d016ad3 could not be found. May 19 13:45:26.862865 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:45:26.862865 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:45:26.862865 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:45:26.862865 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:45:26.862865 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:45:26.862865 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:45:26.862865 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:45:26.862865 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:45:26.862865 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbe881d3-e162-43fb-a5d8-0c954d016ad3 could not be found. May 19 13:45:26.862865 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: ERROR nova.api.openstack.wsgi May 19 13:45:26.864412 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: DEBUG nova.api.openstack.wsgi [None req-8c29f2e9-2893-4a9a-8736-7596b41dbe3c tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Returning 404 to user: Instance fbe881d3-e162-43fb-a5d8-0c954d016ad3 could not be found. {{(pid=120471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:45:26.864412 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO nova.api.openstack.requestlog [None req-8c29f2e9-2893-4a9a-8736-7596b41dbe3c tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "DELETE /compute/v2.1/servers/fbe881d3-e162-43fb-a5d8-0c954d016ad3" status: 404 len: 111 microversion: 2.1 time: 0.030902 May 19 13:45:26.864412 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: [pid: 120471|app: 0|req: 531/1045] 10.222.0.24 () {58 vars in 1238 bytes} [Thu May 19 13:45:26 2022] DELETE /compute/v2.1/servers/fbe881d3-e162-43fb-a5d8-0c954d016ad3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 13:45:26.871159 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-6db989ed-26ec-4c46-a2f7-4bd03a5967b8 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Calling method '>' {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:45:26.871862 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.compute.api [None req-6db989ed-26ec-4c46-a2f7-4bd03a5967b8 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] [instance: fbe881d3-e162-43fb-a5d8-0c954d016ad3] Fetching instance by UUID {{(pid=120472) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:45:26.880643 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-6db989ed-26ec-4c46-a2f7-4bd03a5967b8 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:45:26.881098 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-6db989ed-26ec-4c46-a2f7-4bd03a5967b8 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:45:26.881898 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-6db989ed-26ec-4c46-a2f7-4bd03a5967b8 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:45:26.882334 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG oslo_concurrency.lockutils [None req-6db989ed-26ec-4c46-a2f7-4bd03a5967b8 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Lock "5bd426f0-9e44-4ba7-83d1-d4a29b25b071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:45:26.896729 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.wsgi [None req-6db989ed-26ec-4c46-a2f7-4bd03a5967b8 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] HTTP exception thrown: Instance fbe881d3-e162-43fb-a5d8-0c954d016ad3 could not be found. May 19 13:45:26.898286 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-6db989ed-26ec-4c46-a2f7-4bd03a5967b8 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Request method failure captured: May 19 13:45:26.898286 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: request: GET /compute/v2.1/servers/fbe881d3-e162-43fb-a5d8-0c954d016ad3 HTTP/1.1 May 19 13:45:26.898286 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Accept: application/json May 19 13:45:26.898286 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Accept-Encoding: identity May 19 13:45:26.898286 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Connection: close May 19 13:45:26.898286 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Content-Length: 0 May 19 13:45:26.898286 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Content-Type: application/json May 19 13:45:26.898286 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Host: 10.222.0.24 May 19 13:45:26.898286 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Openstack-System-Scope: None May 19 13:45:26.898286 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: User-Agent: python-urllib3/1.26.9 May 19 13:45:26.898286 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Auth-Token: gAAAAABihkj6liBLvukkw2qtst-UG_cKJZiNcCgt6W_kQDYluV0QF-s3L61GELG86yuBU_XP0oEocHGYFB77RCnoJWx_PSe5oCa2SU8RfG2VbbO9_x7MK34OtxqKFCLvWQmkpMAhKbbulm_ByBEFHwsuhM1s6duzmOYoRlcr_Dq0_GCOhJ038Nk May 19 13:45:26.898286 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Domain-Id: None May 19 13:45:26.898286 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Domain-Name: None May 19 13:45:26.898286 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Identity-Status: Confirmed May 19 13:45:26.898286 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Is-Admin-Project: True May 19 13:45:26.898286 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Domain-Id: default May 19 13:45:26.898286 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Domain-Name: Default May 19 13:45:26.898286 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Id: bc560e8b75194743bbb46d903b481357 May 19 13:45:26.898286 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Project-Name: tempest-AttachVolumeNegativeTest-35839424 May 19 13:45:26.898286 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Role: reader,member May 19 13:45:26.898286 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Roles: reader,member May 19 13:45:26.899922 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/bc560e8b75194743bbb46d903b481357"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/bc560e8b75194743bbb46d903b481357"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_bc560e8b75194743bbb46d903b481357", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/bc560e8b75194743bbb46d903b481357"}]}] May 19 13:45:26.899922 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant: tempest-AttachVolumeNegativeTest-35839424 May 19 13:45:26.899922 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant-Id: bc560e8b75194743bbb46d903b481357 May 19 13:45:26.899922 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-35839424 May 19 13:45:26.899922 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User: tempest-AttachVolumeNegativeTest-35839424-project May 19 13:45:26.899922 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Domain-Id: default May 19 13:45:26.899922 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Domain-Name: Default May 19 13:45:26.899922 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Id: daa4a2a39deb4e7ba54032acec14e029 May 19 13:45:26.899922 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: X-User-Name: tempest-AttachVolumeNegativeTest-35839424-project May 19 13:45:26.899922 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: method: > May 19 13:45:26.899922 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: exception: Instance fbe881d3-e162-43fb-a5d8-0c954d016ad3 could not be found. May 19 13:45:26.899922 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: action_args: {'id': 'fbe881d3-e162-43fb-a5d8-0c954d016ad3'} May 19 13:45:26.901071 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: {{(pid=120472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:45:26.901071 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:45:26.901071 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 13:45:26.901071 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 13:45:26.901071 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 13:45:26.901071 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 13:45:26.901071 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 13:45:26.901071 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 13:45:26.901071 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 13:45:26.901071 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 13:45:26.901071 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbe881d3-e162-43fb-a5d8-0c954d016ad3 could not be found. May 19 13:45:26.901071 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:45:26.901071 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:45:26.901071 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:45:26.901071 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:45:26.901071 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:45:26.901071 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:45:26.901071 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:45:26.901071 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:45:26.901071 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:45:26.902726 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:45:26.902726 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 13:45:26.902726 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 13:45:26.902726 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 13:45:26.902726 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 13:45:26.902726 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 13:45:26.902726 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 13:45:26.902726 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbe881d3-e162-43fb-a5d8-0c954d016ad3 could not be found. May 19 13:45:26.902726 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:45:26.902726 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:45:26.902726 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:45:26.902726 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:45:26.902726 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:45:26.902726 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:45:26.902726 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:45:26.902726 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:45:26.902726 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbe881d3-e162-43fb-a5d8-0c954d016ad3 could not be found. May 19 13:45:26.902726 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: ERROR nova.api.openstack.wsgi May 19 13:45:26.904342 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: DEBUG nova.api.openstack.wsgi [None req-6db989ed-26ec-4c46-a2f7-4bd03a5967b8 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] Returning 404 to user: Instance fbe881d3-e162-43fb-a5d8-0c954d016ad3 could not be found. {{(pid=120472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:45:26.904342 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO nova.api.openstack.requestlog [None req-6db989ed-26ec-4c46-a2f7-4bd03a5967b8 tempest-AttachVolumeNegativeTest-35839424 tempest-AttachVolumeNegativeTest-35839424-project] 10.222.0.24 "GET /compute/v2.1/servers/fbe881d3-e162-43fb-a5d8-0c954d016ad3" status: 404 len: 111 microversion: 2.1 time: 0.034786 May 19 13:45:26.904342 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: [pid: 120472|app: 0|req: 515/1046] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 13:45:26 2022] GET /compute/v2.1/servers/fbe881d3-e162-43fb-a5d8-0c954d016ad3 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 13:46:24.857036 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 13:46:24.858355 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Thu May 19 13:46:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 13:47:14.248953 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 13:47:14.250479 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Thu May 19 13:47:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 13:47:15.399440 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 13:47:15.400097 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Thu May 19 13:47:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 13:48:07.774692 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 13:48:07.775491 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Thu May 19 13:48:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 13:48:24.010553 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 13:48:24.011685 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Thu May 19 13:48:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 13:48:29.938647 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 13:48:29.939141 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Thu May 19 13:48:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 13:49:44.869679 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 13:49:44.871135 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Thu May 19 13:49:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 13:50:34.258877 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 13:50:34.259521 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Thu May 19 13:50:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 13:50:35.409299 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 13:50:35.410443 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Thu May 19 13:50:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 13:51:27.787666 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 13:51:27.788657 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Thu May 19 13:51:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 13:51:44.022863 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 13:51:44.023416 dv-cinder-841125-6-iscsi devstack@n-api.service[120471]: Thu May 19 13:51:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 13:51:49.949226 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 13:51:49.950288 dv-cinder-841125-6-iscsi devstack@n-api.service[120472]: Thu May 19 13:51:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!